Results 1 to 1 of 1

Thread: zmmailbox postRestURL bottleneck ?

  1. #1
    digiuser is offline Starter Member
    Join Date
    Dec 2013
    Posts
    1
    Rep Power
    1

    Default zmmailbox postRestURL bottleneck ?

    Hi all,

    We are trying to move 650Gb of mailboxes from a ZCS7 server to a new ZCS 8/ubuntu 12 server.
    We were told by zimbra support to use the restURL method as we don't want LDAP configuration restored.

    It works fine, but it's slow.
    We can't find why it takes so much time, as CPU and disks do not seem to suffer.

    Let's take a 480MB mailbox, it will take 12 minutes to import

    - with .tgz stored on NFS or local disk
    - with 8 or 12 cores
    - with or without antispam and antivirus started

    We are using postRestURL with resolve=reset:

    Code:
    su - zimbra -c "zmmailbox -z -m $ACCOUNT postRestURL '//?fmt=tgz&resolve=reset' $1/$ACCOUNT.tgz";
    Here are some stats (threaddump and ps -efL attached):

    Code:
    top - 10:34:36 up 26 days, 22:31,  3 users,  load average: 3.60, 3.04, 1.89
    Tasks: 276 total,   1 running, 275 sleeping,   0 stopped,   0 zombie
    Cpu(s): 27.8%us,  3.6%sy,  0.0%ni, 67.4%id,  0.5%wa,  0.0%hi,  0.7%si,  0.0%st
    Mem:  16434704k total, 16278636k used,   156068k free,   653556k buffers
    Swap:  4194300k total,    15592k used,  4178708k free, 10769448k cached
    
      PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
    20096 zimbra    20   0 8004m 1.4g  16m S  202  8.8  21:21.29 java
    20022 zimbra    20   0 4148m 631m 7148 S   27  3.9   2:54.42 mysqld
    31879 zimbra    20   0 1679m 157m  14m S   11  1.0   1:07.79 java
      438 root      20   0     0    0    0 S    6  0.0  29:10.06 jbd2/dm-2-8
    19466 zimbra    20   0  126m  37m 6884 S    6  0.2   0:20.47 httpd
    19467 zimbra    20   0  104m  21m 5772 S    1  0.1   0:14.50 httpd
    
    
    
    Linux 3.8.0-33-generic (zimbra03)       12/28/2013      _x86_64_        (8 CPU)
    
    avg-cpu:  %user   %nice %system %iowait  %steal   %idle
               3.25    0.00    0.52    0.39    0.00   95.83
    
    Device:            tps    kB_read/s    kB_wrtn/s    kB_read    kB_wrtn
    sda              54.83        63.61       535.97  148633043 1252366064
    dm-0              0.05         0.09         0.11     202552     253416
    dm-1              0.00         0.00         0.00       1581        284
    dm-2             67.62        61.56       467.38  143845577 1092094784
    dm-3              0.07         0.71         0.08    1650537     184524
    dm-4              2.33         1.25         9.23    2918269   21578624
    dm-5             14.79         0.01        59.17      12873  138254432
    sdb               2.51        11.75        35.66   27450893   83324788

    Anybody managed to increase import speed with this method ? At some point it looks like it's just slow even if you give it plenty of ram, IO and CPU.

    Thanks for reading
    Best regards,
    Attached Files Attached Files
    Last edited by digiuser; 12-28-2013 at 09:23 AM.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Problem with postRestUrl import
    By branov in forum Migration
    Replies: 1
    Last Post: 09-03-2010, 04:45 AM
  2. postRestURL read timed out with zimbra proxy
    By cayaraa in forum Migration
    Replies: 2
    Last Post: 10-21-2009, 11:01 AM
  3. import speed differences for postRestURL?
    By cayaraa in forum Installation
    Replies: 0
    Last Post: 09-01-2009, 12:45 PM
  4. Replies: 3
    Last Post: 04-09-2008, 07:14 AM

Tags for this Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •