Migrating from CMGPro (CommunigatePro)

[davidfsmith]

Afternoon All

Right I'm running my companies mail on a spare server I managed to "borrow" on a "trial" so I now have a few weeks to get migrated from CMGPro to Zimbra.

Our mail server is now rebuilt and almost ready to play:

[test@test ~]$ uname -a
Linux test.xxxx.com 2.6.9-55.ELsmp #1 SMP Fri Apr 20 16:36:54 EDT 2007 x86_64 x86_64 x86_64 GNU/Linux
[test@test ~]$ df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup_ID_4471-LogVol1
807G 703M 766G 1% /
/dev/sda3 99M 23M 72M 24% /boot
none 3.0G 0 3.0G 0% /dev/shm
/dev/mapper/VolGroup_ID_4471-LogVol3
6.0G 3.1G 2.7G 54% /usr
/dev/mapper/VolGroup_ID_4471-LogVolHome
4.1G 258M 3.6G 7% /home
[test@test ~]$ rpm -qa --queryformat "%{name}.%{version}.%{arch}\n" |grep compat-libstdc
compat-libstdc++-296.2.96.i386
compat-libstdc++-33.3.2.3.x86_64
compat-libstdc++-33.3.2.3.i386

And I've not been quiet in the last few weeks, I've got some scripts that talk to CMGPro and export the account data into some files, one that can be used with IMAPSync and one piping into zmprov to build the accounts, so that should cover the IMAP / POP users and account creation, then I have a script which will read in the calendar / address data and (shortly) pipe that into Zimbra as well, this should cover the MAPI users, I've got 12 days before the migration to Zimbra starts up and once again the interesting bit will be the volume of data to shift (550+ GB)

Regards

[bwoods]

Mind sharing those scripts?

[davidfsmith]

Mind sharing those scripts?

Not at all, but if you can wait a couple of days you can have tested versions....

[bwoods]

Can do!

[davidfsmith]

Ok so attached (hopefully) are the first set of migration scripts I've cobbled together for migrating from CMG to Zimbra

In the zip file:
CLI.pm - Perl Module maintained by www.stalker.com
cmgpro_migration.pl - my cobbled together perl script which produces three files
- zmprov.txt - list of users / alias / lists to feed into zmprov
- zmprovdelete.txt - list of users / lists to feed into zmprov to remove all of the accounts created when using zmprov.txt
- imapusers.txt - list of users / passwords for feeding into imapsycn_batch.sh
imapsync_batch.sh - shell script to call imapsync to migrate emails from CMGPro to Zimbra

All of this works for me, however I accept no responsibility for data loss / hair loss / tax increases / global warming etc.

There is nothing very clever written here, and I'm sure a less rusty programmer could've written it faster / better (be nice I've not written PERL in 4+ years), but here they are....

If you do have problems or questions, let me know and I will try and help.

Also coming soon:

MAPI data migration script, I just need to sort out how to get the ics / vcf data into Zimbra, the PERL script is getting the data just needs something to do with it....

[bwoods]

Thanks! Unfortunately, I can't seem to get passwords out, "guess because i'm using encrypted passwords."

I manually created the list and imported users earlier.

So I have my users imported, now to find a Mailing List solution that doesn't take much knowledge to administer.

[davidfsmith]

The script I wrote gets the list information out, no idea if will work if it can't get the passwords, but worth a look at.

Lines 145 - 179 do this bit

[bwoods]

I have to find an alternative to MailingLists, Mailman looks like one. Do you use mailing lists?

[davidfsmith]

I have to find an alternative to MailingLists, Mailman looks like one. Do you use mailing lists?

Not at the moment, but I've used mailman in the past, worked pretty welll.

[davidfsmith]

Right I now have a kludge cobbled together in PERL which will migrate the diary and contacts for users unlucky enough to have been using CMGPro with the MAPI connector, it needs to run on the CMGPro server and accesses the relevant files before using SSH / SCP to transfer the data to the target Zimbra server where it then uses ZMProv to push the data into the users account, tested on one account so far and it seems to work, not the fastest thing in the world, but less hassle than manually moving the data across for 60 people....

;-)

Will post up how it goes when used over the weekend for the final data migration as we switch over.

The data migration of email is still taking forever, been running IMAPSync since the 16th May, and have managed to transfer 187 accounts (as of this morning)...

There has to be a faster / better way.