Date: Sun, 29 Mar 2015 09:36:58 -0700
From: "W. Trevor King" <wking@tremily.us>
To: Sebastian Fischmeister <sfischme@uwaterloo.ca>
Subject: Re: UnicodeDecodeError with python API
Message-ID: <20150329163658.GK22036@odin.tremily.us>
References: <874mp4q7e7.fsf@uwaterloo.ca>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha1;
	protocol="application/pgp-signature"; boundary="P8VDRTGkfyc6BSVj"
Content-Disposition: inline
In-Reply-To: <874mp4q7e7.fsf@uwaterloo.ca>
OpenPGP: id=39A2F3FA2AB17E5D8764F388FC29BDCDF15F5BE8;
	url=http://tremily.us/pubkey.txt
User-Agent: Mutt/1.5.23 (2014-03-12)
Cc: notmuch <notmuch@notmuchmail.org>
Precedence: list


--P8VDRTGkfyc6BSVj
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Sun, Mar 29, 2015 at 09:08:28AM -0400, Sebastian Fischmeister wrote:
> Traceback (most recent call last):
>   File "./test.py", line 66, in <module>
>     print(type(y.get_part(1)))
>   =E2=80=A6
>   File "/usr/lib/python3.4/email/parser.py", line 54, in parse
>     data =3D fp.read(8192)
>   File "/usr/lib/python3.4/encodings/ascii.py", line 26, in decode
>     return codecs.ascii_decode(input, self.errors)[0]
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 3447=
: ordinal not in range(128)

My first guess is that the file's encoding doesn't match your locale.
Do you have a non-ASCII locale set?  You can check with:

  $ locale
  LANG=3Den_US.UTF-8
  LC_CTYPE=3D"en_US.UTF-8"
  LC_NUMERIC=3D"en_US.UTF-8"
  LC_TIME=3D"en_US.UTF-8"
  LC_COLLATE=3DC
  LC_MONETARY=3D"en_US.UTF-8"
  LC_MESSAGES=3D"en_US.UTF-8"
  LC_PAPER=3D"en_US.UTF-8"
  LC_NAME=3D"en_US.UTF-8"
  LC_ADDRESS=3D"en_US.UTF-8"
  LC_TELEPHONE=3D"en_US.UTF-8"
  LC_MEASUREMENT=3D"en_US.UTF-8"
  LC_IDENTIFICATION=3D"en_US.UTF-8"
  LC_ALL=3D

Although you can obviously have a different preferred language or
Unicode-capable encoding.  What you don't want is:

  # locale
  LANG=3D
  LC_CTYPE=3D"POSIX"
  LC_NUMERIC=3D"POSIX"
  LC_TIME=3D"POSIX"
  LC_COLLATE=3D"POSIX"
  LC_MONETARY=3D"POSIX"
  LC_MESSAGES=3D"POSIX"
  LC_PAPER=3D"POSIX"
  LC_NAME=3D"POSIX"
  LC_ADDRESS=3D"POSIX"
  LC_TELEPHONE=3D"POSIX"
  LC_MEASUREMENT=3D"POSIX"
  LC_IDENTIFICATION=3D"POSIX"
  LC_ALL=3D

If that's not the problem, could you attach the troublesome message?
Or a minimal example derived from the troublesome message?

Cheers,
Trevor

--=20
This email may be signed or encrypted with GnuPG (http://www.gnupg.org).
For more information, see http://en.wikipedia.org/wiki/Pretty_Good_Privacy

--P8VDRTGkfyc6BSVj
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQIcBAEBAgAGBQJVGConAAoJEG8/JgBt8ol86+kP/RLld0FbhJa9Y6LTVsUpw/5c
4Q/fEgbnORSJG1n6OQOy+bAG/N0DUZ06t1tR82ICpYdF8pO2cWGjc8mlwkdqRpA/
hXoHCCPRyOGtgeD+qaTYlyWuXWxw95hEb0IyTlRtAYWqKFlyXT1ZwXrx92kXGNJw
SzIH78telKf7IyO0hJBJrlsRxe+f2vqhzTPDC1Av7xhVflm7Jb/3EWtnqOSsA6aW
yKZdb8nJGjdm0/wwJIBFns6kqsTy5TFpr45nmNfmwf8Uxr5cGHWL3tMVnUXofmsX
7Gje2LBbHJX3sU2lKbNonh5O/t+y4cMVrJI4BCSqFqy3JkNA9GuBgoqyjHh6kEXD
VN2bTS/2JlZfraAmgdF7oVZR8J905HTsaGc9PQK53jWubRXESnWSjIiPW/zqG84v
RCV4eGIAN7rZvQU64AvPkrf6+7/qRueo9+r2ct0M6xQ9CzQHkerweBWE39dCS9LJ
57zWjlwDqvSH/LjZEKJLkm7aCDaphXFOg0exPuxDbBeoRu6Gd+GuNABMVn6lnVpN
Iz/zZ2qcMzsOk+y7NOe5v4AxytCH5gEvZMFncIzoLb6NSQ0DrFpBz7hEUZA/M6YG
TIVhrbaofD1BalRZ5qlUK+kE9NnSqJW8q76rNU2sdqHIAs4+Znl8GQSiPNSFq4gN
i5FMDCfejhVOKVDnyX+l
=ga/y
-----END PGP SIGNATURE-----

--P8VDRTGkfyc6BSVj--