Zimbra offers Open Source email server software and shared calendar for Linux and the Mac
  #1 (permalink)  
Old 04-30-2008, 08:54 AM
jroberts235 jroberts235 is offline
Member
 
Join Date: Dec 2007
Posts: 12
jroberts235 is on a distinguished road
Default Google Enterprise Migration Woes

I am having mixed results using imapsync to migrate 50 users from Google to Zimbra. Some accounts work beautifully, on others, imapsync can't even log in to Google's imap server even though the credentials are correct and IMAP is enabled on all Google accounts. Imapsync sometimes fails with "parse_headers want an ARRAY ref" which I have googled extensively and not found fixes for.

Is there anyone who has done this migration recently?
What tools are you using?
Do I need to better tune imapsync?
Can Fetchmail be used?


I am using:

CentOs-5
zcs-NETWORK-5.0.4_GA_2101.RHEL5 (large file support per Wiki)
imapsync -v 1.250
perl v5.8.8

imapsync $1 --nosyncacls --syncinternaldates --buffersize 8192000 \
--exclude "Trash" --exclude "Deleted Items" \
--exclude "Deleted Messages" --exclude "Deleted" \
--ssl1 --ssl2 --noauthmd5 --authmech1 LOGIN --authmech2 LOGIN \
--host1 $host1 --user1 "$user" --password1 "$p1" \
--host2 $host2 --user2 "$user2" --password2 "$p2"

Thanks in advance for your time and knowledge,
Reply With Quote
  #2 (permalink)  
Old 04-30-2008, 12:29 PM
uxbod's Avatar
uxbod uxbod is offline
Moderator
 
Join Date: Nov 2006
Location: Northampton, UK
ZCS Version: Release 5.0.7_GA_2450.RHEL5_20080630192737 CentOS5 NETWORK edition (Unsupported OS)
Posts: 1,354
uxbod is on a distinguished road
Send a message via MSN to uxbod
Default

Yes fetchmail could be used to inject into the local ZCS MTA (Postfix) instance. The downside I believe is that timestamps etc would not be honoured as it would use the time the MTA received it. Sorry, not done this myself.
__________________
Server | CentOS 5.1 | Dual Opteron 250 | Tyan K8W Mobo | 6GB RAM | 3WARE 9550-SX4 | 4 x Samsung 200GB SATA II |
Zimbra | Release Release 5.0.7_GA_2450.RHEL5_20080630192737 NETWORK edition running under Xen 3.2.1 CentOS 5.2 i386 VM |
Network | Cisco 877 Router - Cisco ASA 5505 FW - Cisco 1131AP |
Reply With Quote
  #3 (permalink)  
Old 04-30-2008, 01:20 PM
jroberts235 jroberts235 is offline
Member
 
Join Date: Dec 2007
Posts: 12
jroberts235 is on a distinguished road
Default

I just saw that in my tests. Unfortunately, that's a deal breaker.
Reply With Quote
  #4 (permalink)  
Old 04-30-2008, 01:24 PM
uxbod's Avatar
uxbod uxbod is offline
Moderator
 
Join Date: Nov 2006
Location: Northampton, UK
ZCS Version: Release 5.0.7_GA_2450.RHEL5_20080630192737 CentOS5 NETWORK edition (Unsupported OS)
Posts: 1,354
uxbod is on a distinguished road
Send a message via MSN to uxbod
Default

Okay, some IMAPSYNC works and some do not. Is that the case ? There is always a solution
__________________
Server | CentOS 5.1 | Dual Opteron 250 | Tyan K8W Mobo | 6GB RAM | 3WARE 9550-SX4 | 4 x Samsung 200GB SATA II |
Zimbra | Release Release 5.0.7_GA_2450.RHEL5_20080630192737 NETWORK edition running under Xen 3.2.1 CentOS 5.2 i386 VM |
Network | Cisco 877 Router - Cisco ASA 5505 FW - Cisco 1131AP |
Reply With Quote
  #5 (permalink)  
Old 04-30-2008, 05:47 PM
jroberts235 jroberts235 is offline
Member
 
Join Date: Dec 2007
Posts: 12
jroberts235 is on a distinguished road
Default

Yes. That is the case.

And it fails with no explanation other than what I posted above.

What are common reasons for imapsync to fail? Large attachments I gathered from previous posts. I set the max email size according to the migration wiki.

What else?
Reply With Quote
  #6 (permalink)  
Old 04-30-2008, 05:50 PM
jroberts235 jroberts235 is offline
Member
 
Join Date: Dec 2007
Posts: 12
jroberts235 is on a distinguished road
Default

I have not tried older versions of imapsync. I read the parse_header error was a bug in ver 1.249, so I was hoping that it would not be in 1.50. Maybe 1.242 (I think is the one before) will be ok?
Reply With Quote
  #7 (permalink)  
Old 05-02-2008, 11:42 AM
jroberts235 jroberts235 is offline
Member
 
Join Date: Dec 2007
Posts: 12
jroberts235 is on a distinguished road
Default

We found that imapsync quits when it finds a piece of mail that has no subject.
Apparently there were a lot of them left over from a migration from Exchange a while back, Contacts that Gmail migrated as emails with no subject header.

We created a patch for imapsync that ignores mails with no subject header and we're back in business.
Reply With Quote
  #8 (permalink)  
Old 05-02-2008, 12:06 PM
webman's Avatar
webman webman is offline
Special Member
 
Join Date: Oct 2007
Location: County Durham, UK
ZCS Version: 5.0.7_GA_2444.UBUNTU6_64 FOSS
Posts: 120
webman is on a distinguished road
Send a message via MSN to webman Send a message via Skype™ to webman
Default

Search the forums for 'x-zimbra-received' - it is a header which can be set when importing mail to apply the correct date.
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] GroupWise 7.0.2 migration Rich Graves Migration 38 04-17-2008 04:13 PM
Migration Wizard: Unable to Open Directory Object ThorGoLucky Administrators 15 01-31-2008 01:01 AM
Migrate from Google Apps to Zimbra? jbwiv Migration 1 12-12-2007 06:19 AM
[SOLVED] Massive migration using imapsync, don't know users passwords dougconley Migration 8 11-15-2007 04:50 PM
Network problems tobuck Installation 28 04-17-2006 03:45 PM


freshmeat.net sourceforge.net The best Java IDE



 

Search Engine Optimization by vBSEO 3.0.0