garbled e-mail and charset

[samotrak]

Hello all,

Sometimes I receive garbled e-mails, if they contain Japanese characters and charset is “shift-jis”.
Most of Japanese mails have “iso-2022-jp" as charset and they look no problem.

Does anybody have the similar problem and workaround?

Problem occurs if mail header has,
Content-Type: text/plain; charset="shift_jis"
Content-Transfer-Encoding: 8bit

Problem does not occur if mail header has,
Content-Type: text/plain; charset="iso-2022-jp"
Content-Transfer-Encoding: 7bit

Thanks,

[dkarp]

Any chance you might be able to post a sample "shift_jis" message? It'd make it easier to debug...

[samotrak]

Thank you for reply. Here is a sample message. Regards,

Received: from localhost (localhost.localdomain [127.0.0.1])
by zimbra01.zimbra.alpha.com (Postfix) with ESMTP id E2072367510
for <campbell@zimbra.alpha.com>; Tue, 18 Jul 2006 01:56:42 -0700 (PDT)
Received: from zimbra01.zimbra.alpha.com ([127.0.0.1])
by localhost (zimbra01.zimbra.alpha.com [127.0.0.1]) (amavisd-new, port 10024)
with ESMTP id 03851-03 for <campbell@zimbra.alpha.com>;
Tue, 18 Jul 2006 01:56:40 -0700 (PDT)
Received: from smtp.zeta.com (unknown [192.168.100.3])
by zimbra01.zimbra.alpha.com (Postfix) with ESMTP id C8EE536750F
for <campbell@zimbra.alpha.com>; Tue, 18 Jul 2006 01:56:39 -0700 (PDT)
Received: by smtp.zeta.com from localhost
(router,SLmail V5.1); Tue, 18 Jul 2006 02:04:45 -0700
for <campbell@alpha.com>
Received: from vsxkg003.ocn.ad.jp [210.232.239.92]
by smtp.zeta.com [192.168.100.3] (SLmail 5.5.0.4433) with ESMTP
id A5B56D21E1CA45A2843EF72EB5ED43AA
for <campbell@alpha.com> plus 2 more; Tue, 18 Jul 2006 02:04:16 -0700
Received: from sgc001.ocn.ne.jp (vc-kg006.ocn.ad.jp [211.129.15.79])
by vsxkg003.ocn.ad.jp (Postfix) with SMTP
id 8ACD8121; Tue, 18 Jul 2006 18:03:46 +0900 (JST)
Received: from MP00385 (unknown [61.213.51.9])
by sgc001.ocn.ne.jp (Postfix) with SMTP
id DF906FD2; Tue, 18 Jul 2006 18:03:45 +0900 (JST)
From: "Sei Sato" <sato@ie.beta.co.jp>
To: <yamashita@beta.co.jp>,
"'Yamaguchi'" <yamaguchi@ie.beta.co.jp>,
<ito@beta.co.jp>
Cc: "Fukuoka" <fukuoka@alpha.com>,
"Tanabe" <tanabe@alpha.com>,
"Campbell" <campbell@alpha.com>
Subject: RE: One Media
Date: Tue, 18 Jul 2006 18:06:17 +0900
Message-ID: <KAEDKDBEMKGHONNKKFIOCECLEDAA.sato@ie.beta.co.jp >
MIME-Version: 1.0
Content-Type: text/plain;
charset="shift_jis"
Content-Transfer-Encoding: 8bit
X-Priority: 3 (Normal)
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0)
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1807
In-reply-to: <000a01c6aa3c$d80d0750$691d0f0a@japan.jpn.beta.co. jp>
Importance: Normal


X-SLUIDL: 70FD78E2-B8D24ADF-B00DADA6-66AEAB4E
X-DSPAM-Result: Innocent
X-DSPAM-Processed: Tue Jul 18 01:56:40 2006
X-DSPAM-Confidence: 0.9997
X-DSPAM-Probability: 0.0000
X-DSPAM-Signature: 44bca24828781804284693
X-DSPAM-Factors: 27,
X-Virus-Scanned: amavisd-new at
X-Spam-Status: No, score=-2.214 tagged_above=-10 required=6.6 autolearn=ham
tests=[AWL=0.350, BAYES_00=-2.599, DSPAM_HAM=-0.1, FORGED_RCVD_HELO=0.135]
X-Spam-Score: -2.214
X-Spam-Level:

R :3q
AMANY
@TKS
B

TO
@cg23q
ALogitechFL#
d
rpOneMediaI.f :3"
B


2!


-----Original Message-----
From: yamashita@beta.co.jp
[mailto:yamashita@beta.co.jp]
Sent: Tuesday, July 18, 2006 4:36 PM
To: 'Sato'; 'Yamaguchi'; ito@beta.co.jp
Subject: One Media


One MediaBlIIqmI;!L iT
[rXE7
B
H :FYI.
http://japan.internet.com/wmnews/2006/4.html?rss

[dkarp]

It'd be better if you posted the message as an attachment. Just click on the "Manage Attachments" button in the "Additional Options" section right below where you enter a new posting...

[samotrak]

Hi, I added the attachment in my previous comment. Thank you!

[iwoodnt]

has this been addressed? I have also noticed that attachment names are encoded in UTF-8 and this causes problems when the attachment name is in Japanese. I have had garbled text in both Thunderbird (Japanese version) and on hotmail.
The body can be viewed by manually changing the character encoding of the viewer (tbird or firefox in my case) but the attachment stays garbled.
I am over the moon that I have zimbra up and running, but this is a real problem for me as most mails that will run on the server will be in Japanese.

Is there a workaround such as changing the default encoding?

[dkarp]

Originally Posted by samotrak

Thank you for reply. Here is a sample message.

That message isn't valid shift_jis. It looks like something -- probably an MTA -- has stripped off the high bits of your 8-bit content. And the result is not parseable as shift_jis.

[iwoodnt]

thanks for the reply. I suppose I will just have to rename attachments into alphanumerics until the servers can handle the attachments properly.

[samotrak]

Hi dkarp and iwoodnt,

Thank you for your follow-up.

That message isn't valid shift_jis. It looks like something -- probably an MTA -- has stripped off the high bits of your 8-bit content. And the result is not parseable as shift_jis.

Umm... probably.
But does it mean ZCS must be able to handle "shift-JIS" with 8bit encoding correctly?

samotrak

[dkarp]

Originally Posted by samotrak

But does it mean ZCS must be able to handle "shift-JIS" with 8bit encoding correctly?

If a message makes it to the Zimbra server with 8bit shift_jis content intact, Zimbra will handle and display it properly.