Attachment error when moving mail between Zimbra Open and Zimbra Network

[daniellawson]

Hi,

I'm currently in the process of migrating one of our clients to Zimbra Network. The two systems are set up with a common GAL and auth system etc, and I'm using the split domain config to handle the changeover.

Running Zimbra Open 3.0.1_GA_160 on Debian, and Zimbra Network 3.1.0_GA_332 on CentOS 4.3. I have the compat libraries installed.

I use imapsync to move mail between the two machines. However, I'm getting a lot of APPEND failures when I do this. Most of these have errors like the following one:

2006-05-07 22:01:53,928 WARN  [ImapServer-5] [ip=10.30.10.3;name=user@domain.co.nz;] ParsedMessage - Parse error on MIME part 1 (text/plain, Message-ID: <2073C654FE5FD311B7DC00902785FD920F7AC986@otherdomain.co.nz>)
com.zimbra.cs.mime.MimeHandlerException: cannot extract text
        at com.zimbra.cs.mime.handler.DefaultHandler.getContentImpl(DefaultHandler.java:92)
        at com.zimbra.cs.mime.MimeHandler.getContent(MimeHandler.java:254)
        at com.zimbra.cs.mime.ParsedMessage.analyzePart(ParsedMessage.java:589)
        at com.zimbra.cs.mime.ParsedMessage.analyzeMessage(ParsedMessage.java:508)
        at com.zimbra.cs.mime.ParsedMessage.analyze(ParsedMessage.java:252)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:2780)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:2766)
        at com.zimbra.cs.imap.ImapHandler.doAPPEND(ImapHandler.java:1208)
        at com.zimbra.cs.imap.ImapHandler$ImapCommand.execute(ImapHandler.java:453)
        at com.zimbra.cs.imap.ImapHandler.processCommand(ImapHandler.java:533)
        at com.zimbra.cs.tcpserver.ProtocolHandler.processConnection(ProtocolHandler.java:231)
        at com.zimbra.cs.tcpserver.ProtocolHandler.run(ProtocolHandler.java:198)
        at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)
Caused by: com.zimbra.cs.convert.ConversionException: unknown request: 32
        at com.zimbra.cs.convert.TransformationClient.extract(TransformationClient.java:179)
        at com.zimbra.cs.convert.SocketTransformationStub.doExtract(SocketTransformationStub.java:99)
        at com.zimbra.cs.convert.SocketTransformationStub.extract(SocketTransformationStub.java:158)
        at com.zimbra.cs.mime.handler.DefaultHandler.getContentImpl(DefaultHandler.java:85)
        ... 13 more
2006-05-07 22:01:53,929 WARN  [ImapServer-5] [ip=10.30.10.3;name=user@domain.co.nz;] ParsedMessage - Message had parse errors in
1 parts (Message-Id: <2073C654FE5FD311B7DC00902785FD920F7AC986@otherdomain.co.nz>, Subject: RE: Union Fees)

Other emails fail with an error closer to the following:

2006-05-07 21:44:55,306 WARN  [ImapServer-1] [ip=10.30.10.3;name=user@domain.co.nz;] ParsedMessage - Parse error on MIME part 3 (image/gif, Message-ID: <D626EC2742AD854AA1EB1FDFD0CC1184C069AD@otherdomain.co.nz>)
com.zimbra.cs.mime.MimeHandlerException: cannot extract text
        at com.zimbra.cs.mime.handler.DefaultHandler.getContentImpl(DefaultHandler.java:92)
        at com.zimbra.cs.mime.MimeHandler.getContent(MimeHandler.java:254)
        at com.zimbra.cs.mime.ParsedMessage.analyzePart(ParsedMessage.java:589)
        at com.zimbra.cs.mime.ParsedMessage.analyzeMessage(ParsedMessage.java:508)
        at com.zimbra.cs.mime.ParsedMessage.analyze(ParsedMessage.java:252)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:2780)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:2766)
        at com.zimbra.cs.imap.ImapHandler.doAPPEND(ImapHandler.java:1208)
        at com.zimbra.cs.imap.ImapHandler$ImapCommand.execute(ImapHandler.java:453)
        at com.zimbra.cs.imap.ImapHandler.processCommand(ImapHandler.java:533)
        at com.zimbra.cs.tcpserver.ProtocolHandler.processConnection(ProtocolHandler.java:231)
        at com.zimbra.cs.tcpserver.ProtocolHandler.run(ProtocolHandler.java:198)
        at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:595)
Caused by: com.zimbra.cs.convert.ConversionException: Cannot connect to convertd
        at com.zimbra.cs.convert.SocketTransformationStub.doExtract(SocketTransformationStub.java:107)
        at com.zimbra.cs.convert.SocketTransformationStub.extract(SocketTransformationStub.java:158)
        at com.zimbra.cs.mime.handler.DefaultHandler.getContentImpl(DefaultHandler.java:85)
        ... 13 more
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
        at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:507)
        at com.zimbra.cs.convert.TransformationClient.connect(TransformationClient.java:58)
        at com.zimbra.cs.convert.TransformationClient.reconnect(TransformationClient.java:207)
        at com.zimbra.cs.convert.SocketTransformationStub.doExtract(SocketTransformationStub.java:102)
        ... 15 more
2006-05-07 21:44:55,308 WARN  [ImapServer-1] [ip=10.30.10.3;name=user@domain.co.nz;] ParsedMessage - Message had parse errors in
3 parts (Message-Id: <D626EC2742AD854AA1EB1FDFD0CC1184C069AD@otherdomain.co.nz>, Subject: RE: Hi)
2006-05-07 21:44:55,308 WARN  [ImapServer-1] [ip=10.30.10.3;name=user@domain.co.nz;] imap - APPEND failed

I've verified that convertd is running. I've tried to disable conversion in the COS and user settings, but this doesn't seem to have any noticeable effect.

[rsharpe]

Running Zimbra Open 3.0.1_GA_160 on Debian, and Zimbra Network 3.1.0_GA_332 on CentOS 4.3. I have the compat libraries installed.

You do realize that the network edition is not supported on CentOS? And will probably not be supported by Zimbra if something should happen to it.

[KevinH]

Are you using the same LDAP directory for both systems? If so that's your problem. You've got a mixed Network/OSS config. It's not supported or tested to work this way. You need to install two individual systems.

[daniellawson]

Are you using the same LDAP directory for both systems? If so that's your problem. You've got a mixed Network/OSS config. It's not supported or tested to work this way. You need to install two individual systems.

They share a common LDAP for GAL and Auth, but have their own LDAP servers otherwise.

[daniellawson]

You do realize that the network edition is not supported on CentOS? And will probably not be supported by Zimbra if something should happen to it

Yes. I do realise this. However we are primarily a debian shop, so if Zimbra Network is ever supported on Debian we'll be very happy. We are doing a test deployment of Zimbra Network on Centos because it is not packaged at all for debian - when we go live with this install it'll be running on RHEL at this stage.

[bobby]

how much ram is in the centos machine?

[daniellawson]

The machine has 1.25 GB of ram - 1280 MB.

[bobby]

you could try giving tomcat some additional ram (the default is 30%):

zmlocalconfig -e tomcat_java_heap_memory_percent=50

if you attach a message that's crashing convertd we can try to reproduce that here. like the first one:
"Caused by: com.zimbra.cs.convert.ConversionException: unknown request: 32
...Subject: RE: Union Fees"