Dirk-Jan C. Binnema | 6 Jun 2009 18:31
Picon

MIME-View UTF8-display issue ('pâté')


(Hope this is the right place for MIME-View questions as well...)

Suppose I write an email in WL with the sentence:
 "Can people distinguish pâté from dog food?"

The interesting word here is "pâté" ("pate" with accents).

Wanderlust sends this correctly, sets the charset correctly so on. And the raw
message text looks like:
  "Can people distinguish p\303\242t\303\251 from dog food?"

The problem is that when I receive this, and view it (in MIME-View), it looks
like:
  "Can people distinguish pt from dog food?"

So, it does not display the accented characters, even though they are
present. It seems like a MIME-View problem; when I make the sentence the
*subject* of the email, it displays fine.

I have some other messages that *do* display accented-characters correctly;
the difference with the Wanderlust-created ones is that all of those are
multipart-MIME messages. It seems MIME-view has trouble with single-part
MIME-messsages.

Anything I can do about this?  

Thanks in advance,
Dirk.

(Continue reading)

Dirk-Jan C. Binnema | 6 Jun 2009 18:31
Picon

MIME-View UTF8-display issue ('pâté')


(Hope this is the right place for MIME-View questions as well...)

Suppose I write an email in WL with the sentence:
 "Can people distinguish pâté from dog food?"

The interesting word here is "pâté" ("pate" with accents).

Wanderlust sends this correctly, sets the charset correctly so on. And the raw
message text looks like:
  "Can people distinguish p\303\242t\303\251 from dog food?"

The problem is that when I receive this, and view it (in MIME-View), it looks
like:
  "Can people distinguish pt from dog food?"

So, it does not display the accented characters, even though they are
present. It seems like a MIME-View problem; when I make the sentence the
*subject* of the email, it displays fine.

I have some other messages that *do* display accented-characters correctly;
the difference with the Wanderlust-created ones is that all of those are
multipart-MIME messages. It seems MIME-view has trouble with single-part
MIME-messsages.

Anything I can do about this?  

Thanks in advance,
Dirk.

(Continue reading)

Heinz Diehl | 7 Jun 2009 10:07

Re: MIME-View UTF8-display issue ('pâté')

On 07.06.2009, Dirk-Jan C. Binnema wrote: 

> the difference with the Wanderlust-created ones is that all of those are
> multipart-MIME messages. It seems MIME-view has trouble with single-part
> MIME-messsages.

I did have the same problems a while ago, and after severel days of
investigation, I gave up. What I found out was that this problem doesn't
occur with emacs 22.x, and it seems to be related to SEMI+emacs-23.

Kazuhiro Ito | 7 Jun 2009 12:01
Picon

Re: MIME-View UTF8-display issue ('pâté')


The message you posted to ML is not encoded as quoted-printable correctly. 
That is FLIM's problem. Please see

http://article.gmane.org/gmane.mail.wanderlust.general.japanese/5978

--

-- 
Kazuhiro Ito

Lloyd Zusman | 7 Jun 2009 17:48

Re: Drafts folder still shows reference to message after it was sent

Sorry for the top posting, but this is just a bounce of my message from
three weeks ago. Does anyone have any thoughts about the question that I
am asking? See below ...

Lloyd Zusman <ljz <at> asfast.com> writes:

> I'm using Wanderlust version 2.15.6.
>
> For quite a while (several Wanderlust versions) I've been noticing
> something that is mildly inconvenient for me.
>
> Suppose that I save an unsent message in the Drafts folder, and that
> later, I go back to that draft, complete it, and then send it.
>
> After the draft has been sent, if I go back to my Folder view, the
> Drafts folder is still highlighted and still shows that the Drafts
> folder contains one message, which is incorrect. I have to enter the
> Drafts folder a second time and then leave it before that folder once
> again shows zero messages.
>
> When I enter the Drafts folder the second time, it is empty, which means
> that the message count is incorrect.
>
> Is there any way to get Wanderlust to show the Drafts folder as being
> empty _immediately_ after I send a previously saved draft, or is there
> no alternative to my entering and leaving the empty Drafts folder a
> second time before its message count is once again shown as zero?
>
> Thanks in advance.

(Continue reading)

Dirk-Jan C. Binnema | 7 Jun 2009 18:22
Picon

Re: MIME-View UTF8-display issue ('pâté')

At Sun, 07 Jun 2009 19:01:05 +0900,
Kazuhiro Ito <kzhr <at> d1.dion.ne.jp> wrote:
> 
> 
> The message you posted to ML is not encoded as quoted-printable correctly. 
> That is FLIM's problem. Please see
> 
> http://article.gmane.org/gmane.mail.wanderlust.general.japanese/5978

Ah -- thank you! I used the linked patch, but it did not seem to make any
difference... 

BTW, there seems to be no problem with *sending* messages; the message have
the correct codes (UTF-8), and I can read the accented characters in other
mail clients (mutt, gmail) correctly.

The problem seems the display of message in WL.

Best wishes,
Dirk.

Kazuhiro Ito | 8 Jun 2009 12:06
Picon

Re: MIME-View UTF8-display issue ('pâté')


> BTW, there seems to be no problem with *sending* messages; the message have
> the correct codes (UTF-8), and I can read the accented characters in other
> mail clients (mutt, gmail) correctly.

In the message you posted to ML, header says that it is encoded in
quoted-printable. But actually it is partially encoded in
quoted-printable and contains UTF-8 raw byte stream. So it is
incorrect as quoted-printable.

Some decoders (mutt, gmail) may treat incorrect data as decoded one,
and others (SEMI) discard them. But I think any behavior is not
incorrect because it is not defined how to precess such illegal
characters.

--

-- 
Kazuhiro Ito

Katsumi Yamaoka | 8 Jun 2009 12:40
X-Face
Favicon
Gravatar

Re: MIME-View UTF8-display issue ('pâté')

>>>>> In [Wanderlust English : No.02823] Dirk-Jan C. Binnema wrote:
> At Sun, 07 Jun 2009 19:01:05 +0900,
> Kazuhiro Ito <kzhr <at> d1.dion.ne.jp> wrote:
>>
>> The message you posted to ML is not encoded as quoted-printable correctly.
>> That is FLIM's problem. Please see
>>
>> http://article.gmane.org/gmane.mail.wanderlust.general.japanese/5978

> Ah -- thank you! I used the linked patch, but it did not seem to make any
> difference...

The patches in that url don't help decoding of such messages.
You tested the patches with the messages you sent in the past
and archived locally (or in a server like Gmane), didn't you?

> BTW, there seems to be no problem with *sending* messages; the message have
> the correct codes (UTF-8),

Your message was obviously broken as Ito-san pointed; the word
"pâté" was encoded by utf-8, but was not encoded as qp afterward.
That's just due to FLIM's problem.

> and I can read the accented characters in other mail clients (mutt, gmail)
> correctly.

Gnus decodes it, too.  The reason WL+SEMI+FLIM doesn't work is
that the qp decoder provided by mel-q-ccl.el doesn't allow data
of in 0x80~0xFF.  But it's not a bug, I think.

(Continue reading)

Dirk-Jan C. Binnema | 8 Jun 2009 20:50
Picon

Re: MIME-View UTF8-display issue ('pâté')


Hi Yamaoka-san,

At Mon, 08 Jun 2009 19:40:27 +0900,
Katsumi Yamaoka <yamaoka <at> jpl.org> wrote:

> > Ah -- thank you! I used the linked patch, but it did not seem to make any
> > difference...
> 
> The patches in that url don't help decoding of such messages.
> You tested the patches with the messages you sent in the past
> and archived locally (or in a server like Gmane), didn't you?
> 
> > BTW, there seems to be no problem with *sending* messages; the message have
> > the correct codes (UTF-8),
> 
> Your message was obviously broken as Ito-san pointed; the word
> "pâté" was encoded by utf-8, but was not encoded as qp afterward.
> That's just due to FLIM's problem.

Ah! Of course! I stand corrected. Thanks for pointing this out.

> Here is a workaround.  Try putting this snippet in your ~/.wl.el
> file.
> 
> (mel-use-module 'mel-q '("quoted-printable" "Q"))
> 
> It lets FLIM use the qp decoder and encoder provided in mel-q.el,
> not mel-q-ccl.el.  Though it might be somewhat slow, probably you
> will not be aware of it.
(Continue reading)

Xavier Maillard | 8 Jun 2009 21:50
Picon

Re: MIME-View UTF8-display issue ('pâté')


> I wrote a little bit about it:
> http://emacs-fu.blogspot.com/2009/06/e-mail-with-wanderlust.html

Nothing related but I am a fellow follower of you blog. I like it
very much.

Xavier


Gmane