Migrating mail between Zimbra servers

[culbeda]

I currently have an Ubuntu 6.06.2 LTS server running Zimbra 5.10 (recently upgraded from 5.06). I'm trying to upgrade to an 8.04.1 server with Zimbra 5.10 (fresh install). I did a full zmbackup on the old server, copied the backup data to the new server and tried to follow the instructions at:

Moving ZCS to New Server - Zimbra :: Wiki

I was able to successfully complete the zmrestoreldap procedure, but I am not able to do a zmrestore of the data using any of the following combinations:

zmrestore -sys -ra -a all -c
zmrestore -sys -ra -a all -c -rf
zmrestore -sys -ra -a all -c -restoreToTime 20081016.050823.758
zmrestore -sys -ra -a all -c -lb full-20081016.050823.758

All attempts generate a "java.lang.NullPointerException" with the following in the mailbox.log file:

java.lang.NullPointerException
        at com.zimbra.cs.redolog.RedoLogManager.isRolloverNeeded(RedoLogManager.java:542)
        at com.zimbra.cs.redolog.RedoLogManager.rollover(RedoLogManager.java:584)
        at com.zimbra.cs.redolog.RedoLogManager.forceRollover(RedoLogManager.java:621)
        at com.zimbra.cs.redolog.RedoLogManager.forceRollover(RedoLogManager.java:617)
        at com.zimbra.cs.backup.FileBackupTarget.restore(FileBackupTarget.java:407)
        at com.zimbra.cs.backup.BackupManager.restore(BackupManager.java:716)
        at com.zimbra.cs.backup.BackupManager.restore(BackupManager.java:656)
        at com.zimbra.cs.service.backup.Restore.handle(Restore.java:124)
        at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:411)
        at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:268)
        at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:160)
        at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:269)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
        at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:189)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:487)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1093)
        at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
        at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:148)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1084)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:360)
        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:716)
        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:406)
        at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:211)
        at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:139)
        at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:350)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:139)
        at org.mortbay.jetty.Server.handle(Server.java:313)
        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:506)
        at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:844)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:644)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:211)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:381)
        at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:396)
        at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:442)

Unfortunately, the zmrestoreoffline utility doesn't work either, but it just sits there and never returns. It does generate the following (partial)

2008-10-16 14:27:07,324 WARN  [main] [] misc - Could not establish a connection to the database.  Retrying in 5 seconds.
com.zimbra.common.service.ServiceException: system failure: getting database connection
ExceptionId:main:1224192427324:ed47fc98d643b7e3
Code:service.FAILURE
        at com.zimbra.common.service.ServiceException.FAILURE(ServiceException.java:253)
        at com.zimbra.cs.db.DbPool.getConnection(DbPool.java:236)
        at com.zimbra.cs.util.Zimbra.waitForDatabase(Zimbra.java:122)
        at com.zimbra.cs.util.Zimbra.startup(Zimbra.java:163)
        at com.zimbra.cs.util.Zimbra.startupCLI(Zimbra.java:141)
        at com.zimbra.cs.backup.RestoreOfflineUtil.setup(RestoreOfflineUtil.java:101)
        at com.zimbra.cs.backup.RestoreOfflineUtil.main(RestoreOfflineUtil.java:46)
Caused by: com.mysql.jdbc.exceptions.MySQLNonTransientConnectionException: Server connection failure during transaction. Due to underlying exception: 'java.net.SocketException: java.net.ConnectException: Connection refused'.

** BEGIN NESTED EXCEPTION **

java.net.SocketException
MESSAGE: java.net.ConnectException: Connection refused

STACKTRACE:

java.net.SocketException: java.net.ConnectException: Connection refused
        at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156)
        at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:276)
        at com.mysql.jdbc.Connection.createNewIO(Connection.java:2769)
        at com.mysql.jdbc.Connection.<init>(Connection.java:1531)
        at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266)
        at java.sql.DriverManager.getConnection(DriverManager.java:525)
        at java.sql.DriverManager.getConnection(DriverManager.java:140)
        at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:97)
        at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:300)
        at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:816)
        at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:140)
        at com.zimbra.cs.db.DbPool.getConnection(DbPool.java:227)
        at com.zimbra.cs.util.Zimbra.waitForDatabase(Zimbra.java:122)
        at com.zimbra.cs.util.Zimbra.startup(Zimbra.java:163)
        at com.zimbra.cs.util.Zimbra.startupCLI(Zimbra.java:141)
        at com.zimbra.cs.backup.RestoreOfflineUtil.setup(RestoreOfflineUtil.java:101)
        at com.zimbra.cs.backup.RestoreOfflineUtil.main(RestoreOfflineUtil.java:46)


** END NESTED EXCEPTION **


Attempted reconnect 3 times. Giving up.
        at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:888)
        at com.mysql.jdbc.Connection.createNewIO(Connection.java:2838)
        at com.mysql.jdbc.Connection.<init>(Connection.java:1531)
        at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266)
        at java.sql.DriverManager.getConnection(DriverManager.java:525)
        at java.sql.DriverManager.getConnection(DriverManager.java:140)
        at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:97)
        at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:300)
        at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:816)
        at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:140)
        at com.zimbra.cs.db.DbPool.getConnection(DbPool.java:227)
        ... 5 more

Anyone have any clues? This is the second replacement server I have built and the second one that has failed to restore properly. (from different backups on different versions of Zimbra (5.06 and 5.10)).

Thanks,

Dave

[culbeda]

Anyone? I'm more than a littles screwed if I can't resolve this because my old server is having SCSI errors (ESX on a NetApp iSCSI SAN) and the only decent answers to that seem to be upgrade a 2.6.22 or higher.

[irfan]

Are you using Network edition or FOSS of zimbra? There are two sections in the wiki.

[culbeda]

I'm using the network edition (but email only). I'll open a ticket if necessary, but I was hoping not to get dinged the $$$ for what appeas to be a bug in their software.

[irfan]

I think you should simple use following wiki instead:

Network Edition: Moving from 32-bit to 64-bit Server - Zimbra :: Wiki

If you are going with previous wiki, from the error it looks like mysql.server is not runnning. it should be running while doing zmrestoreoffline.

su - zimbra
mysql.server start