[SOLVED] Problem during imapsync

[Oded Arbel]

Hi.

I have a problem running imapsync to migrate IMAP accounts from an old Cyrus-imap server to Zimbra 6.0.4.

I'm running this command:

imapsync --buffersize 8192000 --nosyncacls --subscribe --syncinternaldate --noauthmd5 \
  --host1 old.server --user1 old.user --password1 123456 \
  --host2 localhost --user2 user@domain.com --password2 123456

It then scans the old server properly and then when it tries to copy the first message (about 350K in size, so its not a size limit problem):

++++ Verifying [INBOX] -> [INBOX] ++++
+ NO msg #12894 [yJdYP4oUu321UV45EeFjvQ:357554] in INBOX
+ Copying msg #12894:357554 to folder INBOX
flags from: []["06-Feb-2010 10:08:44 -0500"]
Couldn't append msg #12894 (Subject:[e-mail subject]) to folder INBOX: * BYE server1.domain.com IMAP4rev1 server terminating connection
+ NO msg #12895 [ljqyg5c5V7+4cSrp+A0h2w:2254] in INBOX
+ Copying msg #12895:2254 to folder INBOX
++++ End looping on each folder ++++
error: lost connection host2 [localhost](len=67) * BYE server1.domain.com IMAP4rev1 server terminating connection

As you can see, I'm running the imapsync on the local server. What troubles me is that there is no error message - Zimbra just says "BYE".

[Oded Arbel]

Update: apparently it only happens with some specific message with specific content - I get daily emails which are HTML with a lot of large image attachments, and Zimbra fails to receive those.

[Oded Arbel]

Another update about the failed imapsync:

A. I opened the problematic accounts in Thunderbird, and tried to copy using thunderbird from the INBOX on the old server to the INBOX on the new server. It doesn't work, and I also do not get any errors from Thunderbird.

B. I can forward these problematic e-mails to myself, and it works and I get them, but then Thunderbird complains that it can't copy the sent email to the "Sent" folder, so maybe the problem is with the content, but its acceptable through SMTP but not through IMAP?

C. I found another message, less problemat - its just some HTML - which Zimbra doesn't like - imapsync fails to copy it with the same non-message as above and Thunderbird fails to copy it with no error message. I attached the message as I get it from Thunderbird's "Save As".

[rhys_rhaven]

Having the same issues migrating from an old Dovecot server to Zimbra. From imapsync. Also, Evolution gives me an error moving -any- mail from my old account to my new account. "Connection Reset by Peer" Also attached is the mailbox.log javaIO exception.

F message content ended on previous line
================================================== ==============================
internal date from 1: [16-Dec-2009 09:20:59 -0600]
internal date from 1: ["16-Dec-2009 09:20:59 -0600"] (fixed)
flags from: [\Answered \Seen]["16-Dec-2009 09:20:59 -0600"]
Couldn't append msg #4365 (Subject:[Phone System]) to folder INBOX: * BYE mail.domain.com IMAP4rev1 server terminating connection
+ key NFWrCKLoVUnAK6HvS1+fRg:2727 #4366
+ NO msg #4366 [NFWrCKLoVUnAK6HvS1+fRg:2727] in INBOX
+ Copying msg #4366:2727 to folder INBOX
++++ End looping on each folder ++++
error: last command: (len=69) 19 APPEND INBOX (\Answered \Seen) "16-Dec-2009 09:20:59 -0600" {7445}
error: lost connection (to) host2 [mail.domain.com](len=62) * BYE mail.domain.com IMAP4rev1 server terminating connection

[rhys_rhaven]

From /opt/zimbra/log/mailbox.log

2010-02-17 00:17:03,207 INFO [ImapSSLServer-8] [] ProtocolHandler - Handler exiting normally
2010-02-17 00:18:01,994 INFO [Timer-Zimbra] [] SessionCache - Removed 1 idle sessions (ADMIN). 2 active sessions remain.
2010-02-17 00:20:04,207 INFO [btpool0-28://localhost:7071/service/admin/soap/AuthRequest] [ip=127.0.0.1;] soap - AuthRequest
2010-02-17 00:20:04,298 INFO [btpool0-28://localhost:7071/service/admin/soap/GetAllServersRequest] [name=zimbra;ip=127.0.0.1;] soap - GetAllServersRequest
2010-02-17 00:21:01,994 INFO [Timer-Zimbra] [] SessionCache - Removed 2 idle sessions (SOAP, ADMIN). 1 active sessions remain.
2010-02-17 00:24:40,605 INFO [ImapServer-10] [] imap - [xx.xxx.x46.158] connected
2010-02-17 00:24:40,893 INFO [ImapServer-10] [name=user@domain.com;ip=xx.xxx.x46.158;] imap - user user@domain.com authenticated, mechanism=LOGIN [TLS]
2010-02-17 00:24:41,013 INFO [ImapServer-10] [name=user@domain.com;ip=xx.xxx.x46.158;] imap - selected folder INBOX
2010-02-17 00:24:49,086 INFO [ImapServer-10] [ip=xx.xxx.x46.158;] ProtocolHandler - Exception occurred while handling connection
java.io.IOException: Unable to create blob store directory /opt/zimbra/store/incoming
at com.zimbra.cs.store.file.FileBlobStore.ensureDirEx ists(FileBlobStore.java:372)
at com.zimbra.cs.store.file.FileBlobStore.ensureParen tDirExists(FileBlobStore.java:376)
at com.zimbra.cs.store.file.FileBlobStore.getUniqueIn comingBlob(FileBlobStore.java:67)
at com.zimbra.cs.store.file.FileBlobStore.getBlobBuil der(FileBlobStore.java:73)
at com.zimbra.cs.imap.Literal$BlobLiteral.<init>(Lite ral.java:121)
at com.zimbra.cs.imap.Literal.newInstance(Literal.jav a:36)
at com.zimbra.cs.imap.TcpImapRequest.continueLiteral( TcpImapRequest.java:106)
at com.zimbra.cs.imap.TcpImapRequest.continuation(Tcp ImapRequest.java:48)
at com.zimbra.cs.imap.TcpImapHandler.processCommand(T cpImapHandler.java:83)
at com.zimbra.cs.tcpserver.ProtocolHandler.processCon nection(ProtocolHandler.java:175)
at com.zimbra.cs.tcpserver.ProtocolHandler.run(Protoc olHandler.java:132)
at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Wo rker.run(Unknown Source)
at java.lang.Thread.run(Thread.java:619)
2010-02-17 00:24:49,086 INFO [ImapServer-10] [] ProtocolHandler - Handler exiting normally

[Oded Arbel]

Thanks for pointing me at mailbox.log.

In my log I get a NullPointerException:

2010-02-17 02:16:42,886 INFO  [ImapServer-4856] [ip=10.228.102.117;] ProtocolHandler - Exception occurred while handling connection
java.lang.NullPointerException
	at com.zimbra.cs.mime.ParsedMessage.initialize(ParsedMessage.java:212)
	at com.zimbra.cs.mime.ParsedMessage.<init>(ParsedMessage.java:155)
	at com.zimbra.cs.imap.AppendMessage.store(AppendMessage.java:132)
	at com.zimbra.cs.imap.AppendMessage.storeContent(AppendMessage.java:121)
	at com.zimbra.cs.imap.ImapHandler.doAPPEND(ImapHandler.java:2074)
	at com.zimbra.cs.imap.ImapHandler.executeRequest(ImapHandler.java:308)
	at com.zimbra.cs.imap.TcpImapHandler.processCommand(TcpImapHandler.java:99)
	at com.zimbra.cs.tcpserver.ProtocolHandler.processConnection(ProtocolHandler.java:175)
	at com.zimbra.cs.tcpserver.ProtocolHandler.run(ProtocolHandler.java:132)
	at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
	at java.lang.Thread.run(Thread.java:619)

[Oded Arbel]

This apparently was a bug (Bugzilla bug #43359) that was fixed in ZCS 6.0.5 . If anyone is having this problem - I recommend upgrading.

[rhys_rhaven]

I woke up this morning knowing what caused this. I had recently mounted my 1TB RAID10 array as /opt/zimbra/store. It was exiting when it filled up the buffer, tried to write to disk, and got an error, permission denied.

chown zimbra:zimbra /opt/zimbra/store did the trick. works now.

[Labat]

Does anyone have any idea what would cause this error while trying to run an IMAP Sync?
Error login: [server.domain.com] with user [email@domain.com] auth [PLAIN]: 2 NO AUTHENTICATE failed

[phoenix]

Does anyone have any idea what would cause this error while trying to run an IMAP Sync?
Error login: [server.domain.com] with user [email@domain.com] auth [PLAIN]: 2 NO AUTHENTICATE failed

There's a couple of threads with that error mentioned.