[SOLVED] Truncated Messages

[shmiv]

This is a very serious issue and could lead to our moving back to Microsoft Exchange. We have customers that are upset that we aren't sending requested information when in fact some part of Zimbra is truncating part of the message. I know this has happened two times and can replicate the situation. I am very concerned that it could be happening more frequently. How do I go about getting some help? Please note, however, that I will not have access to a computer again until late on 11/2/2008, but I appreciate all the suggestions and requests for additional information that I am so hopeful will be there.

After our recent upgraded from FOSS 5.0.5 to 5.0.10 we are noticing email messages getting truncated (the email received is shorter than the email sent). I have done a bit of experimenting and found that it appears to be related to the length and format of the email.

1. HTML formatted emails do not seem to get truncated.
2. Shorter emails do not get trunctated.

We are adding a disclaimer to the end of each outgoing email.

Any help is greatly appreciated. I will post any additional information that you think would help. I have an email for which this phenomena is very repeatable.

[shmiv]

Still an issue.

[shmiv]

Still need help. Any ideas?

[uxbod]

If you remove the disclaimer does it still happen ? Could you ask one of your customers so send the full email including headers so you could post it somewhere ? We can take a look then to see how it is getting mangled.

[shmiv]

The two examples that I have contain proprietary information that I cannot post. I will try to remove this information while maintaining the truncation effect.

I will also attempt re-sending w/o the disclaimer too see what happens.

The emails are truncated even when sent internally; I don't need to involve external resources when testing.

Thanks!

[shmiv]

I have not tried turning off disclaimer message yet, but here is what I sent and what was received.

Note that I changed our actual domain to "domain" and removed a customer name ("Ron has been very busy with M").

SENT

Date: Tue, 4 Nov 2008 13:32:02 -0500 (EST)
From: Mack <mack@domain.com>
To: mack <mack@domain.com>
Message-ID: <19726166.11551225823522894.JavaMail.root@mail.domain.com>
Subject: Email Trunk 20081104.09
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Originating-IP: [192.168.123.31]
X-Mailer: Zimbra 5.0.10_GA_2609.UBUNTU6 (ZimbraWebClient - FF3.0 (Win)/5.0.10_GA_2609.UBUNTU6)

Will,

Attached is our rate sheet that is good through the end of 2008. We are cur=
rently investigating price increases that will likely be effective 1/1/2009=
.

I'm sure there is a way we can work together in a way that is mutually bene=
ficial. There are several ways that we can justify pricing discounts:

   1. Guaranteed minimum levels of invoicing.
   2. Guaranteed minimum quantity of hours.

Hours at your office, in Roanoke, would be invoiced at the same rate as hou=
rs at our office.

We are happy to discuss these and other scenarios with you.

Thanks,
Mack=20
Donain, Inc.
111-222-3333 x444

----- Original Message -----
From: "Mack " <mack.@domain.com>
To: "Will " <W@customer.com>
Cc: "Ron " <ron.@domain.com>
Sent: Wednesday, October 8, 2008 7:44:08 AM GMT -05:00 US/Canada Eastern
Subject: Re: Rates

Will,

Ron has been very busy with M. I'll look into your request and get yo=
u something by the end of the week. I apologize for the delay.

Thanks,
Mack=20
Donain, Inc.
111-222-3333 x444

----- Original Message -----
From: "Will " <W@customer.com>
To: "Mack " <mack.@domain.com>, "Ron " <ron.@domain.com>
Cc: "Justin " <J@customer.com>
Sent: Wednesday, October 8, 2008 7:15:49 AM GMT -05:00 US/Canada Eastern
Subject: Rates




I=E2=80=99m assuming that you guys are interested in the rate request that =
I sent. I admit the jobs will be very small and hardly worthwhile for you. =
But we really want to use you and will pay just about any price.



Thanks



Signature-W  Final



Thanks,
Mack=20
Donain, Inc.
111-222-3333 x444

RECEIVED

Return-Path: mack@domain.com
Received: from mail.domain.com (LHLO mail.domain.com) (192.168.123.12)
 by mail.domain.com with LMTP; Tue, 4 Nov 2008 13:32:03 -0500 (EST)
Received: from localhost (localhost [127.0.0.1])
	by mail.domain.com (Postfix) with ESMTP id B96FD5E6BC
	for <mack@domain.com>; Tue,  4 Nov 2008 13:32:03 -0500 (EST)
X-Virus-Scanned: amavisd-new at 
X-Spam-Flag: NO
X-Spam-Score: -4.3
X-Spam-Level: 
X-Spam-Status: No, score=-4.3 tagged_above=-10 required=6.6
	tests=[ALL_TRUSTED=-1.8, AWL=0.099, BAYES_00=-2.599]
Received: from mail.domain.com ([127.0.0.1])
	by localhost (mail.domain.com [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id vMM8mnSz2IqL for <mack@domain.com>;
	Tue,  4 Nov 2008 13:32:03 -0500 (EST)
Received: by mail.domain.com (Postfix, from userid 1000)
	id 2BF175E6C4; Tue,  4 Nov 2008 13:32:03 -0500 (EST)
Received: from mail.domain.com (mail.domain.com [192.168.123.12])
	by mail.domain.com (Postfix) with ESMTP id 156BF5E6BC
	for <mack@domain.com>; Tue,  4 Nov 2008 13:32:03 -0500 (EST)
Date: Tue, 4 Nov 2008 13:32:02 -0500 (EST)
From: Mack  <mack@domain.com>
To: mack <mack@domain.com>
Message-ID: <19726166.11551225823522894.JavaMail.root@mail.domain.com>
Subject: Email Trunk 20081104.09
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Originating-IP: [192.168.123.31]
X-Mailer: Zimbra 5.0.10_GA_2609.UBUNTU6 (ZimbraWebClient - FF3.0 (Win)/5.0.10_GA_2609.UBUNTU6)

Will,

Attached is our rate sheet that is good through the end of 2008. We are cur=
rently investigating price increases that will likely be effective 1/1/2009=

[dkarp]

Looks like a SMTP transparency problem (RFC 2821, section 4.5.2). But nobody else has had this issue and we haven't changed either our SMTP client (JavaMail) or our LMTP server.

Are you running anything else on your network that might be mishandling SMTP transparency? An antispam/antivirus box, a nonstandard amavis plugin?

[bburtin]

On the surface, it looks like the SMTP client is sending "." instead of using SMTP transparency and sending "..". See

RFC 2821 - Simple Mail Transfer Protocol

for more details.

I just tried sending the following message:

a
.
b

from one Zimbra account to another Zimbra account, and it worked. Can you please post the exact steps that reproduce the problem? Which mail client is the user using? Is the message sent from one account on the Zimbra server to another account on the Zimbra server? What process are you using to add the disclaimer? Are you able to trace the SMTP protocol to see what the client is sending? Also, be sure to run another test without the disclaimer.

[shmiv]

We are using Zimbra pretty much "out of the box".

- we do NOT have an antispam/antivirus box.
- we ARE using amavis that "ships" with Zimbra.
- I don't think the example posted would have never left our Zimbra box.
- We have NOT installed any other software on our Zimbra box.
- I DO modify the master.cf postfix file per wiki to add disclaimer using two ip addresses to avoid disclaimer being added to incoming.

I plan to test w/o the disclaimer on one morning this week.

[shmiv]

I just tested without the disclaimer on (put old master.cf back, restarted zimbra) and the example email went fine.

It looks like it is not a Zimbra issue (yea!).

We really need to be able to have a disclaimer added to all outgoing emails. Is there any reason the "filter" would truncate some text messages but no (so far) HTML formatted messages?