Results 1 to 7 of 7

Thread: 22,000 mailboxes - recommended configuration?

  1. #1
    emacias is offline Junior Member
    Join Date
    Nov 2009
    Posts
    9
    Rep Power
    5

    Default 22,000 mailboxes - recommended configuration?

    Hi LMStone:

    We want to install Zimbra using aprox. 22 thounsand mailboxes with quotes from 300 MB and 1 GB. Our infraestructure has Blades Servers and NetApp's SAN. Blade have one disk with 146 GB but by security the most logic is to use SAN for installing /opt/zimbra.

    Layout Disk:

    The mailbox server includes the following volumes:
    • Message Store. Mail message files are in opt/zimbra/store
    • Data Store. The MySQL Database files are in opt/zimbra/db
    • Index Store. Index files are in opt/zimbra/index
    • Backup Area. Full and incremental backups are in opt/zimbra/backup
    • Log files. Each component in the Zimbra Collaboration Suite has log files. Local logs are in /opt/zimbra/log

    By these 22.000 mailboxes what's your recomendation:

    Create one LUN with all directory /opt/zimbra?, create LUN for each volumen or other option?

    Thanks for your help!

  2. #2
    Krishopper is offline Dedicated Member
    Join Date
    Dec 2006
    Location
    Minneapolis MN
    Posts
    775
    Rep Power
    9

    Default

    Hello,

    We have it set up such that the entire /opt/zimbra is on the SAN. That way if we lose an entire blade, we can easily re-map those LUN's to another blade, mount up the entire /opt/zimbra volume, and quickly get back online without much hassle.

    I'm not sure if that's the best way to do it, or if anyone else is doing it any different, but it works quite well here.

  3. #3
    Klug's Avatar
    Klug is offline Moderator
    Join Date
    Mar 2006
    Location
    Beaucaire, France
    Posts
    2,292
    Rep Power
    13

    Default

    If you go the volume way, add a volume for redologs.

  4. #4
    LMStone's Avatar
    LMStone is offline Moderator
    Join Date
    Sep 2006
    Location
    477 Congress Street | Portland, ME 04101
    Posts
    1,366
    Rep Power
    10

    Default

    Quote Originally Posted by emacias View Post
    Hi LMStone:

    We want to install Zimbra using aprox. 22 thounsand mailboxes with quotes from 300 MB and 1 GB. Our infraestructure has Blades Servers and NetApp's SAN. Blade have one disk with 146 GB but by security the most logic is to use SAN for installing /opt/zimbra.

    Layout Disk:

    The mailbox server includes the following volumes:
    • Message Store. Mail message files are in opt/zimbra/store
    • Data Store. The MySQL Database files are in opt/zimbra/db
    • Index Store. Index files are in opt/zimbra/index
    • Backup Area. Full and incremental backups are in opt/zimbra/backup
    • Log files. Each component in the Zimbra Collaboration Suite has log files. Local logs are in /opt/zimbra/log

    By these 22.000 mailboxes what's your recomendation:

    Create one LUN with all directory /opt/zimbra?, create LUN for each volumen or other option?

    Thanks for your help!
    How many separate LUNs to create in our experience is really dependent on the quality of the SAN. If you have something like an EMC CX4 or better, there is so much cache in the SAN that the underlying disk configurations become less of a bottleneck and you can get by with fewer LUNs on fewer separate arrays.

    One client with a big virtualized LAMP stack had a runaway MySL server writing 1GB bin-log files every three minutes to the CX4, and no one noticed any performance degradation at all (Nagios let us know the bin-log partition was getting filled though...) Very few LUNs here and only two underlying arrays.

    We have recently come across JetStor iSCSI SANs; these are basically JBOD shelves fitted with a SAN controller. The customer uses this SAN for SAS files (big, big, big data files and temporary working sets), but the performance is about on par with DASD, so you need more LUNs on separate arrays.

    I would however try to save some money by using a RAID6 array for /opt/zimbra/backup (with bigger, slower drives) and one or more RAID10 arrays for everything else, with faster drives.

    I don't like single drives in blade servers BTW; if you are comfortable installing the operating system (SLES!?) on a SAN mount I would do so. FWIW the very first generation of IBM blade servers had no on-board disks whatsoever, but too many customers couldn't get their heads around having everything on the SAN. Now, we build a lot of ESXi servers with ESXi on an internal 4GB USB stick and use all the on-board disks for the datastores. Go figure...

    So, which Netapp are you using? And what features have you licensed? That will help me to be more specific.

    All the best,
    Mark
    Last edited by LMStone; 07-02-2010 at 12:05 PM.

  5. #5
    emacias is offline Junior Member
    Join Date
    Nov 2009
    Posts
    9
    Rep Power
    5

    Default

    We actually have FAS3020 with protocol FCP or IScsi, By the side Blade, we use CentOS, ZCS totally Open Source free, with connection to SAN by FC 4 Gb multipath.

    We have discs trays's NetApp of High performance and discs trays of high capacity

  6. #6
    LMStone's Avatar
    LMStone is offline Moderator
    Join Date
    Sep 2006
    Location
    477 Congress Street | Portland, ME 04101
    Posts
    1,366
    Rep Power
    10

    Default

    NetApp have an Exchange 2003 deployment whitepaper that incorporates their best practices regarding LUNs and other configuration options on a FAS3040 with 14,000 Exchange mailboxes in a four-server configuration.

    http://media.netapp.com/documents/Ne...3040-fcsan.pdf

    It's interesting that in the doc above, everything is DP (RAID6), not RAID10. But, that's what you get with huge cache on the SAN.

    Hope that helps,
    Mark

  7. #7
    leog21 is offline Special Member
    Join Date
    Sep 2007
    Posts
    123
    Rep Power
    7

    Default

    Hi Emacias,

    Can you please update us on what config you went with and how its all working out?

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Ubuntu 8.04 Lts Zimbra 5.0.14 Ldap Problem
    By rkrojero in forum Installation
    Replies: 10
    Last Post: 04-20-2009, 11:58 PM
  2. Replies: 3
    Last Post: 02-14-2009, 12:09 AM
  3. From POP3 and 100 scattered mailboxes to Zimbra
    By spiderman in forum Administrators
    Replies: 5
    Last Post: 08-11-2006, 08:00 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •