[SOLVED] zmmailboxmove fails - HttpMethodDirector - I/O exception broken

[schulze]

Hi all,

we have 2 mbox servers and want to move one mailbox from one server to the other. This has been working before, but now we get the following error in the mailbox.log:

2009-10-02 08:47:46,660 INFO  [btpool0-2] [name=zimbra;ip=127.0.0.1;] soap - ExportMailboxRequest
2009-10-02 08:47:46,948 INFO  [btpool0-2] [name=zimbra;ip=127.0.0.1;] backup - Full backup started for backup set; label: move-20091002.064746.948
2009-10-02 08:47:46,948 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] backup - redo log file sequence is 183 at full backup for schulze@informatik.uni-tuebingen.de
2009-10-02 08:47:46,948 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] backup - Full backup started for account schulze@informatik.uni-tuebingen.de (26c455d3-3c14-4435-916e-0f0044b9261e) mailbox 26
2009-10-02 08:47:46,950 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] mailbox - Locking mailbox 26 for maintenance.
2009-10-02 08:47:50,720 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] backup - Number of blobs to backup for mailbox 26: 34522
2009-10-02 08:49:03,179 INFO  [LmtpServer-499] [ip=134.2.9.105;] lmtp - try again for address schulze@informatik.uni-tuebingen.de: account status maintenance
2009-10-02 08:49:03,179 INFO  [LmtpServer-499] [ip=134.2.9.105;] lmtp - 450 4.2.1 Mailbox disabled, not accepting messages (RCPT TO:<schulze@informatik.uni-tuebingen.de>)
2009-10-02 08:49:03,179 INFO  [LmtpServer-499] [ip=134.2.9.105;] lmtp - 503 5.5.1 No recipients (DATA)
2009-10-02 08:49:03,339 INFO  [LmtpServer-499] [ip=134.2.9.105;] ProtocolHandler - Handler exiting normally
2009-10-02 08:50:24,560 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] backup - Stored 34522 blob files from volume message1
2009-10-02 08:50:24,560 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] backup - Stored 34522 blob files
2009-10-02 08:50:45,219 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] backup - Stored 24 index files
2009-10-02 08:50:45,220 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] mailbox - Ending maintenance on mailbox 26.
2009-10-02 08:50:45,220 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] mbxmgr - Mailbox 26 account 26c455d3-3c14-4435-916e-0f0044b9261e AVAILABLE
2009-10-02 08:50:45,220 INFO  [btpool0-2] [name=schulze@informatik.uni-tuebingen.de;mid=26;ip=127.0.0.1;] backup - Full backup finished for account schulze@informatik.uni-tuebingen.de (26c455d3-3c14-4435-916e-0f0044b9261e) mailbox 26
2009-10-02 08:50:45,305 INFO  [btpool0-2] [ip=127.0.0.1;] backup - Finished backing up 1 of 1 accounts
2009-10-02 08:50:45,305 INFO  [btpool0-2] [ip=127.0.0.1;] backup - Full backup finished for backup set; label: move-20091002.064746.948
2009-10-02 08:51:15,474 INFO  [btpool0-2] [ip=127.0.0.1;] HttpMethodDirector - I/O exception (java.net.SocketException) caught when processing request: Broken pipe
2009-10-02 08:51:15,474 INFO  [btpool0-2] [ip=127.0.0.1;] HttpMethodDirector - Retrying request
2009-10-02 08:51:15,561 INFO  [btpool0-2] [ip=127.0.0.1;] mboxmove - Mailbox move: 208891 millisec with error
2009-10-02 08:51:15,561 INFO  [btpool0-2] [ip=127.0.0.1;] SoapEngine - handler exception
com.zimbra.common.service.ServiceException: system failure: Failed to export mailbox from source server zcs-bi.informatik.uni-tuebingen.de
ExceptionId:btpool0-2:1254466275552:1cb07075ac9f1067
Code:service.FAILURE
        at com.zimbra.common.service.ServiceException.FAILURE(ServiceException.java:253)
        at com.zimbra.cs.service.backup.ExportMailbox.handleNetworkRequest(ExportMailbox.java:252)
        at com.zimbra.cs.service.NetworkDocumentHandler.handle(Unknown Source)
        at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:429)
        at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:286)
        at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:160)
        at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:275)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
        at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:190)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1093)
        at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
        at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:148)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1084)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:360)
        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:716)
        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:406)
        at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:211)
        at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:139)
        at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:350)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:139)
        at org.mortbay.jetty.Server.handle(Server.java:313)
        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:506)
        at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:844)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:644)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:211)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:381)
        at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:396)
        at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:442)
Caused by: org.apache.commons.httpclient.ProtocolException: Unbuffered entity enclosing request can not be repeated.
        at org.apache.commons.httpclient.methods.EntityEnclosingMethod.writeRequestBody(EntityEnclosingMethod.java:483)
        at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:1973)
        at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:993)
        at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:397)
        at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:170)
        at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396)
        at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:324)
        at com.zimbra.cs.service.backup.ExportMailbox.handleNetworkRequest(ExportMailbox.java:204)
        ... 31 more

Any idea, why there is an IO error / broken pipe?

Thanks,
Jan

[phoenix]

Check if your self-signed certificates have expired and regenerate them if they have.

[schulze]

Unfortunately, that does not seem to be the problem. All certificates are valid until at least February 2010.

[schulze]

There was not enough RAM on the source server. After reducing the mailbox size, we were able to move the mailbox without problems.

[UEDan]

I'm sorry, I have to bum this old post.
But anyone have any idea on how schulze was able to "reduce" the inbox size?
I have more than a few 5+GB inboxes from a crashed server that I need to get on the new one.
Thanks.