Migrate from Zimbra 6.0.10 on MacOSX to Zimbra 7.1.3 on Ubuntu 10.04 LTS

[Paolo Campanelli]

Hi, we have a single server installation (with a single domain) running MacOSX Server 10.4 with Zimbra 6.0.10_GA_2692.MACOSXx86 Network Edition and we must migrate on a new server Linux with Ubuntu 10.04 LTS. We wish at the same time upgrading to current 7.1.3 Zimbra release. What steps must be followed so that all go wrong? Thank you for your help.

Paolo

[phoenix]

Did you look at some of the forum threads and/or wiki articles covering the subject of moving Zimbra to a new server? If this is a move to a 64bit server then go to the wiki and read the Certified article on moving from a 32bit to 64bit platform.

[rcilink]

Not too long ago, we had the same situation..

We were running Zimbra 5.x on MAC OSX and needed to move to 64bit to get better performance (and to upgrade to Zimbra 7.x along the way)...

Here's what we did:

1. The "new" server was setup as a single Zimbra domain, with a second domain to alias all users into. This way, we did not have the @mail.fake.com showing in email messages, just @fake.com addresses. The second domain alias allows us to route email to the Zimbra server from the front-end mail server (running a serious spam filer).

2. The new server is NOT named the same as the old server (different IP address also)

3. Gave-up on 'migration' as discussed all over on the forums. We wanted to be able to extract a user account on the old server and import it into the new server. Some pieces change, but most settings can be moved over. I ended up writing scripts to do this. The script can do the export of the user account (including all the settings for the user), fix any settings that need fixing, and import them into the new server. Then the mailbox is backed-up from the old server and restored on the new server. Once user(s) are run through the script, the old server is set to forward any incoming email to the new server account (using the email alias).

--
Some parts get messy;

- We had users on ZCS 5.x that used the "Notebook". That does not move to the new server. (export or save contents from old server.)

- The user "email signature" did not move easily so we let them set signatures on the new server themselves.

- using the Backup / Restore of the "emailed contacts" gets messy. You end up with @oldserver.fake.com addresses in the new server user accounts. I am working on a cleanup script to sanitize the address books prior to shutting-down the old zimbra server.

- We had many "shared calendars" on the old server. These don't move to the new server and remain working. (mostly due to the internal IDs not matching up.) Easiest way we handled this was to delete the shared calendars and re-push the shares out to users. (to clarify: we have many shared calendars for multiple buildings that we automatically share into the user accounts. The process is invisible to the user-- they are automatically 'subscribed' to the shared resource.) If you do not have many large-scale shared resources, this may not be a problem to you.

I can't think of more at the moment. If you are doing the move yourself, give yourself plenty of time. If you do it like we did and leave both servers online, you will be able to move one or two accounts to actually see what you are up against.

I want to say it was several days to get the 850+ accounts moved and setup with their shares, etc.

[Paolo Campanelli]

Originally Posted by phoenix

Did you look at some of the forum threads and/or wiki articles covering the subject of moving Zimbra to a new server? If this is a move to a 64bit server then go to the wiki and read the Certified article on moving from a 32bit to 64bit platform.

Thank you phoenix. I followed the Certified article on moving from a 32bit to 64bit platform, at the end (6.0.10 on Ubuntu 10.04 LTS) I started zimbra:
Starting ldap...Done.
Starting logger...Done.
Starting convertd...Done.
Starting mailbox...Done.
Starting antispam...Done.
Starting antivirus...Done.
Starting snmp...Done.
Starting spell...Done.
Starting mta...Done.
Starting stats...Done.

this is after zmcontrol status:

antispam Running
antivirus Running
convertd Running
ldap Running
logger Running
mailbox Stopped
zmmailboxdctl is not running.
mta Running
snmp Running
spell Running
stats Running

I noticed that on the old server was installed tomcat, while there is not installed in the new one.

Can you suggest where looking for the problem and which log files to check?

Thanks a lot.

Paolo

[phoenix]

Originally Posted by Paolo Campanelli

Can you suggest where looking for the problem and which log files to check?

Have you looked in the log files, start with /var/log/zimbra.log.

[Paolo Campanelli]

Originally Posted by phoenix

Have you looked in the log files, start with /var/log/zimbra.log.

Thank you phoenix, I tried to empty the zmmailboxd_manager.pid$ file and restart but unsuccessfully, this is the zimbra.log file:

Jan 4 09:49:09 xserve zimbramon[4698]: 4698:info: Starting services initiated by zmcontrol
Jan 4 09:49:09 xserve slapd[4758]: @(#) $OpenLDAP: slapd 2.4.23 (Aug 6 2010 12:44:14) $#012#011root@zre-ubuntu10-64:/home/build/p4/GNR/ThirdParty/openldap/openldap-2.4.23.2z/server
s/slapd
Jan 4 09:49:10 xserve slapd[4759]: slapd starting
Jan 4 09:49:17 xserve zimbramon[4698]: 4698:info: Rewriting configs antispam amavis antivirus amavis webxml mailbox amavis antispam antivirus mta sasl
Jan 4 09:49:36 xserve zimbramon[4698]: 4698:info: Starting logger via zmcontrol
Jan 4 09:49:39 xserve zimbramon[4698]: 4698:info: Starting convertd via zmcontrol
Jan 4 09:49:39 xserve zimbramon[4698]: 4698:info: Starting mailbox via zmcontrol
Jan 4 09:49:39 xserve zimbramon[6810]: 6810:info: zmmtaconfig: zmmtaconfig started on xserve.fbassociati.it with loglevel=3 pid=6810
Jan 4 09:50:01 xserve zmmailboxdmgr[9867]: status requested
Jan 4 09:50:01 xserve zmmailboxdmgr[9867]: did not find a number in /opt/zimbra/log/zmmailboxd_manager.pid
Jan 4 09:50:01 xserve zmmailboxdmgr[9867]: assuming no other instance is running
Jan 4 09:50:01 xserve zmmailboxdmgr[9867]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 4 09:50:01 xserve zmmailboxdmgr[9867]: assuming no other instance is running
Jan 4 09:50:01 xserve zmmailboxdmgr[9867]: no manager process is running
Jan 4 09:50:01 xserve zmmailboxdmgr[9874]: start requested
Jan 4 09:50:01 xserve zmmailboxdmgr[9874]: checking if another instance of manager is already running
Jan 4 09:50:01 xserve zmmailboxdmgr[9874]: did not find a number in /opt/zimbra/log/zmmailboxd_manager.pid
Jan 4 09:50:01 xserve zmmailboxdmgr[9874]: assuming no other instance is running
Jan 4 09:50:01 xserve zmmailboxdmgr[9874]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 4 09:50:01 xserve zmmailboxdmgr[9874]: assuming no other instance is running
Jan 4 09:50:01 xserve zmmailboxdmgr[9875]: wrote manager pid 9875 to /opt/zimbra/log/zmmailboxd_manager.pid
Jan 4 09:50:01 xserve zmmailboxdmgr[9875]: manager started mailboxd/JVM with pid 9876
Jan 4 09:50:01 xserve zmmailboxdmgr[9876]: wrote java pid 9876 to /opt/zimbra/log/zmmailboxd_java.pid
Jan 4 09:50:01 xserve zimbramon[4698]: 4698:info: Starting antispam via zmcontrol
Jan 4 09:50:01 xserve postfix/postqueue[9964]: fatal: Queue report unavailable - mail system is down
Jan 4 09:50:01 xserve zimbramon[9929]: 9929:info: 2012-01-04 09:50:01, QUEUE: 0 0
Jan 4 09:50:01 xserve amavis[9936]: starting. /opt/zimbra/amavisd/sbin/amavisd at xserve.fbassociati.it amavisd-new-2.6.4 (20090625), Unicode aware, LANG="it_IT.UTF-8"
Jan 4 09:50:01 xserve amavis[9936]: user=1001, EUID: 1001 (1001); group=, EGID: 1004 4 5 1004 1005 (1004 4 5 1004 1005)
Jan 4 09:50:01 xserve amavis[9936]: Perl version 5.010001
Jan 4 09:50:01 xserve zmmailboxdmgr[9875]: manager woke up from wait on mailboxd/JVM with pid 9876
Jan 4 09:50:01 xserve zmmailboxdmgr[9875]: manager started mailboxd/JVM with pid 10150
Jan 4 09:50:01 xserve zmmailboxdmgr[10150]: wrote java pid 10150 to /opt/zimbra/log/zmmailboxd_java.pid
Jan 4 09:50:02 xserve amavis[9936]: SpamControl: init_pre_chroot on SpamAssassin done
Jan 4 09:50:02 xserve amavis[10229]: Net::Server: Process Backgrounded
Jan 4 09:50:02 xserve amavis[10229]: Net::Server: 2012/01/04-09:50:02 Amavis (type Net::Server::PreForkSimple) starting! pid(10229)
Jan 4 09:50:02 xserve amavis[10229]: Net::Server: Binding to UNIX socket file /opt/zimbra/data/amavisd/amavisd.sock using SOCK_STREAM
Jan 4 09:50:02 xserve amavis[10229]: Net::Server: Binding to TCP port 10024 on host 127.0.0.1
Jan 4 09:50:02 xserve amavis[10229]: Net::Server: Group Not Defined. Defaulting to EGID '1004 4 5 1004 1005'
Jan 4 09:50:02 xserve amavis[10229]: Net::Server: User Not Defined. Defaulting to EUID '1001'
Jan 4 09:50:02 xserve amavis[10229]: Module Amavis::Conf 2.207
Jan 4 09:50:02 xserve amavis[10229]: Module Archive::Zip 1.30
Jan 4 09:50:02 xserve amavis[10229]: Module Compress::Zlib 2.024
Jan 4 09:50:02 xserve amavis[10229]: Module Convert::TNEF 0.17
Jan 4 09:50:02 xserve amavis[10229]: Module Convert::UUlib 1.33
Jan 4 09:50:02 xserve amavis[10229]: Module Crypt::OpenSSL::RSA 0.26
Jan 4 09:50:02 xserve amavis[10229]: Module DBD::mysql 4.013
Jan 4 09:50:02 xserve amavis[10229]: Module DBI 1.609
Jan 4 09:50:02 xserve amavis[10229]: Module DB_File 1.82
Jan 4 09:50:02 xserve amavis[10229]: Module Digest::MD5 2.39
Jan 4 09:50:02 xserve amavis[10229]: Module Digest::SHA 5.48
Jan 4 09:50:02 xserve amavis[10229]: Module IO::Socket::INET6 2.59
Jan 4 09:50:02 xserve amavis[10229]: Module MIME::Entity 5.427
Jan 4 09:50:02 xserve amavis[10229]: Module MIME::Parser 5.427
Jan 4 09:50:02 xserve amavis[10229]: Module MIME::Tools 5.427
Jan 4 09:50:02 xserve amavis[10229]: Module Mail:KIM::Signer 0.37
Jan 4 09:50:02 xserve amavis[10229]: Module Mail:KIM::Verifier 0.37
Jan 4 09:50:02 xserve amavis[10229]: Module Mail::Header 2.06
Jan 4 09:50:02 xserve amavis[10229]: Module Mail::Internet 2.06
Jan 4 09:50:02 xserve amavis[10229]: Module Mail::SPF v2.007
Jan 4 09:50:02 xserve amavis[10229]: Module Mail::SpamAssassin 3.003001
Jan 4 09:50:02 xserve amavis[10229]: Module Net:NS 0.66
Jan 4 09:50:02 xserve amavis[10229]: Module Net::LDAP 0.40
Jan 4 09:50:02 xserve amavis[10229]: Module Net::Server 0.97
Jan 4 09:50:02 xserve amavis[10229]: Module NetAddr::IP 4.027
Jan 4 09:50:02 xserve amavis[10229]: Module Socket6 0.23
Jan 4 09:50:02 xserve amavis[10229]: Module Time::HiRes 1.9721
Jan 4 09:50:02 xserve amavis[10229]: Module URI 1.53
Jan 4 09:50:02 xserve amavis[10229]: Module Unix::Syslog 1.1
Jan 4 09:50:02 xserve amavis[10229]: Amavis:B code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: Amavis::Cache code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: SQL base code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: SQL::Log code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: SQL::Quarantine NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: Lookup::SQL code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: Lookup::LDAP code loaded
Jan 4 09:50:02 xserve amavis[10229]: AM.PDP-in proto code loaded
Jan 4 09:50:02 xserve amavis[10229]: SMTP-in proto code loaded
Jan 4 09:50:02 xserve amavis[10229]: Courier proto code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: SMTP-out proto code loaded
Jan 4 09:50:02 xserve amavis[10229]: Pipe-out proto code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: BSMTP-out proto code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: Local-out proto code loaded
Jan 4 09:50:02 xserve amavis[10229]: OS_Fingerprint code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: ANTI-VIRUS code loaded
Jan 4 09:50:02 xserve amavis[10229]: ANTI-SPAM code loaded
Jan 4 09:50:02 xserve amavis[10229]: ANTI-SPAM-EXT code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: ANTI-SPAM-C code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: ANTI-SPAM-SA code loaded
Jan 4 09:50:02 xserve amavis[10229]: Unpackers code loaded
Jan 4 09:50:02 xserve amavis[10229]: DKIM code loaded
Jan 4 09:50:02 xserve amavis[10229]: Tools code NOT loaded
Jan 4 09:50:02 xserve amavis[10229]: Found $file at /usr/bin/file
Jan 4 09:50:02 xserve amavis[10229]: No $altermime, not using it
Jan 4 09:50:02 xserve amavis[10229]: Internal decoder for .mail
Jan 4 09:50:02 xserve amavis[10229]: Internal decoder for .asc
Jan 4 09:50:02 xserve amavis[10229]: Internal decoder for .uue
Jan 4 09:50:02 xserve amavis[10229]: Internal decoder for .hqx
Jan 4 09:50:02 xserve amavis[10229]: Internal decoder for .ync
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .F tried: unfreeze, freeze -d, melt, fcat
Jan 4 09:50:02 xserve amavis[10229]: Found decoder for .Z at /bin/uncompress
Jan 4 09:50:02 xserve amavis[10229]: Found decoder for .gz at /bin/gzip -d
Jan 4 09:50:02 xserve amavis[10229]: Found decoder for .bz2 at /bin/bzip2 -d
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .lzo tried: lzop -d
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .rpm tried: rpm2cpio.pl, rpm2cpio
Jan 4 09:50:02 xserve amavis[10229]: Found decoder for .cpio at /bin/cpio
Jan 4 09:50:02 xserve amavis[10229]: Found decoder for .tar at /bin/cpio
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .deb tried: ar
Jan 4 09:50:02 xserve amavis[10229]: Internal decoder for .zip
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .7z tried: 7zr, 7za, 7z
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .rar tried: rar, unrar
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .arj tried: arj, unarj
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .arc tried: nomarch, arc
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .zoo tried: zoo, unzoo
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .lha tried: lha
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .cab tried: cabextract
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .tnef tried: tnef
Jan 4 09:50:02 xserve amavis[10229]: Internal decoder for .tnef
Jan 4 09:50:02 xserve amavis[10229]: No decoder for .exe tried: rar, unrar; lha; arj, unarj
Jan 4 09:50:02 xserve amavis[10229]: Using primary internal av scanner code for ClamAV-clamd
Jan 4 09:50:02 xserve amavis[10229]: initializing Mail::SpamAssassin
Jan 4 09:50:02 xserve zimbramon[4698]: 4698:info: Starting antivirus via zmcontrol
Jan 4 09:50:02 xserve clamd[10370]: clamd daemon 0.96.5-broken-compiler (OS: linux-gnu, ARCH: x86_64, CPU: x86_64)
Jan 4 09:50:02 xserve clamd[10370]: Log file size limited to 20971520 bytes.
Jan 4 09:50:02 xserve clamd[10370]: Reading databases from /opt/zimbra/data/clamav/db
Jan 4 09:50:02 xserve clamd[10370]: Not loading PUA signatures.
Jan 4 09:50:02 xserve zmmailboxdmgr[9875]: manager woke up from wait on mailboxd/JVM with pid 10150
Jan 4 09:50:02 xserve zmmailboxdmgr[9875]: mailboxd/JVM exited twice in 1 seconds (tolerance=60)
Jan 4 09:50:04 xserve zmmailboxdmgr[10639]: status requested
Jan 4 09:50:04 xserve zmmailboxdmgr[10639]: stale pid 9875 found in /opt/zimbra/log/zmmailboxd_manager.pid: No such process
Jan 4 09:50:04 xserve zmmailboxdmgr[10639]: assuming no other instance is running
Jan 4 09:50:04 xserve zmmailboxdmgr[10639]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 4 09:50:04 xserve zmmailboxdmgr[10639]: assuming no other instance is running
Jan 4 09:50:04 xserve zmmailboxdmgr[10639]: no manager process is running
Jan 4 09:50:07 xserve clamd[10370]: Loaded 1044425 signatures.
Jan 4 09:50:07 xserve clamd[10370]: TCP: Bound to address 127.0.0.1 on port 3310
Jan 4 09:50:07 xserve clamd[10370]: TCP: Setting connection queue length to 15
Jan 4 09:50:07 xserve clamd[10772]: Limits: Global size limit set to 36700160 bytes.
Jan 4 09:50:07 xserve clamd[10772]: Limits: File size limit set to 36700160 bytes.
Jan 4 09:50:07 xserve clamd[10772]: Limits: Recursion level limit set to 16.
Jan 4 09:50:07 xserve clamd[10772]: Limits: Files limit set to 10000.
Jan 4 09:50:07 xserve clamd[10772]: Archive support enabled.
Jan 4 09:50:07 xserve clamd[10772]: Archive: Blocking encrypted archives.
Jan 4 09:50:07 xserve clamd[10772]: Algorithmic detection enabled.
Jan 4 09:50:07 xserve clamd[10772]: Portable Executable support enabled.
Jan 4 09:50:07 xserve clamd[10772]: ELF support enabled.
Jan 4 09:50:07 xserve clamd[10772]: Mail files support enabled.
Jan 4 09:50:07 xserve clamd[10772]: OLE2 support enabled.
Jan 4 09:50:07 xserve clamd[10772]: PDF support enabled.
Jan 4 09:50:07 xserve clamd[10772]: HTML support enabled.
Jan 4 09:50:07 xserve clamd[10772]: Self checking every 600 seconds.
Jan 4 09:50:12 xserve zimbramon[4698]: 4698:info: Starting snmp via zmcontrol
Jan 4 09:50:12 xserve zimbramon[4698]: 4698:info: Starting spell via zmcontrol
Jan 4 09:50:12 xserve zimbramon[4698]: 4698:info: Starting mta via zmcontrol
Jan 4 09:50:21 xserve amavis[10229]: SpamControl: init_pre_fork on SpamAssassin done
Jan 4 09:50:21 xserve amavis[10229]: extra modules loaded after daemonizing/chrooting: Mail/SpamAssassin/Plugin/FreeMail.pm
Jan 4 09:50:33 xserve postfix/postfix-script[12344]: warning: not owned by root: /opt/zimbra/data/postfix/spool
Jan 4 09:50:33 xserve postfix/postfix-script[12352]: warning: not owned by root: /opt/zimbra/postfix-2.6.7.2z/conf/main.cf
Jan 4 09:50:33 xserve postfix/postfix-script[12353]: warning: not owned by root: /opt/zimbra/postfix-2.6.7.2z/conf/master.cf
Jan 4 09:50:33 xserve postfix/postfix-script[12354]: warning: not owned by root: /opt/zimbra/postfix-2.6.7.2z/conf/master.cf.in
Jan 4 09:50:33 xserve postfix/postfix-script[12368]: starting the Postfix mail system
Jan 4 09:50:33 xserve postfix/master[12369]: daemon started -- version 2.6.7, configuration /opt/zimbra/postfix-2.6.7.2z/conf
Jan 4 09:50:33 xserve saslauthd[12377]: detach_tty : master pid is: 12377
Jan 4 09:50:33 xserve saslauthd[12377]: ipc_init : listening on socket: /opt/zimbra/cyrus-sasl-2.1.23.3z/state/mux
Jan 4 09:50:33 xserve zimbramon[4698]: 4698:info: Starting stats via zmcontrol
Jan 4 09:50:57 xserve zmmailboxdmgr[14021]: status requested
Jan 4 09:50:57 xserve zmmailboxdmgr[14021]: stale pid 9875 found in /opt/zimbra/log/zmmailboxd_manager.pid: No such process
Jan 4 09:50:57 xserve zmmailboxdmgr[14021]: assuming no other instance is running
Jan 4 09:50:57 xserve zmmailboxdmgr[14021]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 4 09:50:57 xserve zmmailboxdmgr[14021]: assuming no other instance is running
Jan 4 09:50:57 xserve zmmailboxdmgr[14021]: no manager process is running
Jan 4 09:51:11 xserve zmmailboxdmgr[15464]: status requested
Jan 4 09:51:11 xserve zmmailboxdmgr[15464]: stale pid 9875 found in /opt/zimbra/log/zmmailboxd_manager.pid: No such process
Jan 4 09:51:11 xserve zmmailboxdmgr[15464]: assuming no other instance is running
Jan 4 09:51:11 xserve zmmailboxdmgr[15464]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 4 09:51:11 xserve zmmailboxdmgr[15464]: assuming no other instance is running
Jan 4 09:51:11 xserve zmmailboxdmgr[15464]: no manager process is running

Any suggestions?

Thank you.

[vavai]

Due to your problem regarding zmmailboxdctl is not running, would you like to paste relevant error messages on your /opt/zimbra/log/mailbox.log. I suspect there is an error about database/java credentials.

[Paolo Campanelli]

Originally Posted by vavai

Due to your problem regarding zmmailboxdctl is not running, would you like to paste relevant error messages on your /opt/zimbra/log/mailbox.log. I suspect there is an error about database/java credentials.

In /opt/zimbra/log/mailbox.log there is only the first start log after the clean installation of yesterday. After moving data from the old server there is no more entries in mailbox.log. Zimbra doesn't seem to write more on mailbox.log.

[Paolo Campanelli]

There is another way to move the accounts and their data? Can I do a clean installation on the new server and then transferring the full backup from the old server? With a full restore on the new server, then I can restore all the mail accounts, calendar, address book etc..? Thank you.

[Paolo Campanelli]

Finally I solved following the chapter "Disaster Recovery Changing Servers" in this guide. Thank you very much to everybody.