650,000 Mailbox Migration Qmail-LDAP 2 Zimbra NE

[pointer]

bonoboslr,

Thanks for posting the migration info. I'm getting ready to start a similar--albeit smaller--migration with courier on the old system.

/mike

[bonoboslr]

Good luck. Hope all goes well!

[fernandoflorez]

Originally Posted by bonoboslr

$ zmlicense -p
AccountsLimit=650000

OMG! I fell off my chair!

I would love to see pics from your servers. First time i have met someone with that amount of mailboxes.

Congratz!

[bonoboslr]

Ok. Update - as you can see from the numbers below we are well, well into the migration. Had some issues initially with our load balanced MTAs. SpamAssassin is dog slow... Anyway, because we have spam wall protecting our mail servers, we turned antispam off.

We also decided to make a slight design change - instead of having a cluster of load balanced MTAs we decided to split the functionalitys of the MTAs. Half would perform relay functionality and the other half will performing inbound MX. This overcomes postix's problem of only having 1 queue.

Over 1/5 of our users have been migrated and we (at the moment) are not even requiring more than 1 MTA. OK, it does have 12Gb RAM and 8 Cores!
But we will be adding to them on Monday.

If anyone does considering using the external data source as a method of migrating mailbox data -

zimbraScheduledTaskNumThreads

should be tuned to what is required.

zimbra_mail=# select count(*) from users;
count
--------
119160

[bonoboslr]

Migration - Week1 Bonobo’s Blog

For those that have an interest.

[uxbod]

Will be keeping an eye on your blog ... very interesting indeed.

[bonoboslr]

Bonobo’s Blog

Some pretty graphs...

[flums]

Really looking forward to se the end of this migration and som stats. Would you consider sharing zmstats?

[cmargena]

Originally Posted by bonoboslr

We are using SAN storage for index,redolog,logs,db/data,store,secondary_store. We have opted for maximum spindles as possible to increase performance. IOPs I will be able to give a better indication when we are in full swing. It will be negligible just now as we do not have that many users migrated across and they are all still using pop. Our intention is to change that though.

I cannot see us deploying more than 4 of each proxies or SMTP servers sun galaxy 4450s are phenominal beasts. Lots of disks, lots of cores, lots of RAM!!

zimbra_mail=# select count(*) from users;
count
-------
54423

Still quite a few!

Do you have any detail on SAN disks, Are they SCSI or SATA?

[ab5602]

Wow, congrats on the successes so far bonoboslr!

-Rob