Results 1 to 6 of 6

Thread: Zimbra on Hadoop

  1. #1
    tagman is offline Starter Member
    Join Date
    Jul 2009
    Posts
    2
    Rep Power
    5

    Default Zimbra on Hadoop

    Hi all,
    We are a small company that are trying to use ZCS mainly for email purposes. Internally we use Hadoop as our distributed file system and wanted to continue using that for the ZCS. Has any one integrated Zimbra with Hadoop? Specifically we want all data used by Zimbra to use Hadoop Distributed File System instead of the local filesystem. Thus all the message store etc should reside on hadoop. Any help on this regard is extremely appreciated.

  2. #2
    uxbod's Avatar
    uxbod is offline Moderator
    Join Date
    Nov 2006
    Location
    UK
    Posts
    8,017
    Rep Power
    24

    Default

    Welcome to the forums

    Well if you want the datastore on a alternative file system then why not just present the storage and mount it under /opt/zimbra/store ?

  3. #3
    tagman is offline Starter Member
    Join Date
    Jul 2009
    Posts
    2
    Rep Power
    5

    Default Thanks

    Hey uxbod,
    Thanks for the quick reply.
    I am very new to Zimbra so please excuse me if these are very naive questions. I looked at the option of mounting Hadoop as a regular file system using FUSE. There are a couple of issues that I can't find answers for
    1. Has anyone done any performance testing using FUSE mounting of Hadoop and using Zimbra? Our email traffic is fairly significant(and includes lots of big messages) so this is a very moot point.
    2. Does all data that zimbra creates/uses reside on /opt/zimbra/store? Including any temporary scratch data, etc? Basically if a particular machine running zimbra goes down for whatever reason, does switching on another machine work?
    Thanks in advance!

  4. #4
    y@w's Avatar
    y@w
    y@w is offline Moderator
    Join Date
    Jan 2008
    Posts
    658
    Rep Power
    8

    Default

    I haven't worked with hadoop specifically, so I can't answer the question about performance, but I would imagine you would set it up the same way you would for a ZCS cluster on a SAN only with a different filesystem..

    Cluster Install for Single-Node ConfigurationFor Red Hat Cluster Suite Integration

  5. #5
    johnmclain is offline Starter Member
    Join Date
    Jul 2009
    Posts
    2
    Rep Power
    6

    Default file lock issues?

    i was just thinking what could go wrong with "simply switching" over to another machine...
    Is it because zimbra could be setting up locks on certain files on the mount? ...which then would be an issue when another machine tries to access it.

    maybe some one with more clarity wouldbe able to confirm this.

    Cheers,
    jmc

  6. #6
    JoshuaPrismon is offline Zimlet Guru & Moderator
    Join Date
    Nov 2005
    Posts
    477
    Rep Power
    9

    Default

    Quote Originally Posted by tagman View Post
    Hi all,
    We are a small company that are trying to use ZCS mainly for email purposes. Internally we use Hadoop as our distributed file system and wanted to continue using that for the ZCS. Has any one integrated Zimbra with Hadoop? Specifically we want all data used by Zimbra to use Hadoop Distributed File System instead of the local filesystem. Thus all the message store etc should reside on hadoop. Any help on this regard is extremely appreciated.
    I like the idea of using one of the "slacker databases" like CouchDB or Hadoop DFS to save store filesystems, but I don't think that it's a easy implementation to do it in a way that Zimbra doesn't recognize. However, there is a closed RFE that might make this possible:

    Bug 30550 – Support for third party blob stores

    There are some interesting ideas. If you do LDAP replication/MySQL replication and have the blog store in a replicated file store, this could be a very flexable and powerful system.

    Check it out.
    Last edited by JoshuaPrismon; 07-19-2009 at 01:42 PM.

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Replies: 8
    Last Post: 01-12-2012, 02:20 AM
  2. slapd message error
    By smoke in forum Administrators
    Replies: 7
    Last Post: 04-27-2008, 03:23 PM
  3. admin consol blank after 5.0.3 upgarde
    By maumar in forum Administrators
    Replies: 6
    Last Post: 03-21-2008, 05:16 AM
  4. Replies: 12
    Last Post: 02-25-2008, 07:28 PM
  5. Zimbra shutdowns every n hours.
    By Andrewb in forum Administrators
    Replies: 13
    Last Post: 08-14-2007, 08:55 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •