Page 3 of 12 FirstFirst 12345 ... LastLast
Results 21 to 30 of 115

Thread: ldap database went from 97meg to 86gig

  1. #21
    ccelis5215 is offline Elite Member
    Join Date
    Jun 2011
    Location
    Caracas Venezuela
    Posts
    462
    Rep Power
    4

    Default

    Quote Originally Posted by kevindods View Post
    just to note that was time cp /opt/zimbra/data/ldap/mdb/db/data.mdb test-data.mdbRunning on Ubuntu, Ext4 on RAID10 15K drives - 8 cores 16GB RAMHouston - we have problem... as they probably didnt say!Bill: Where can we take this next?
    In Centos 6.3 rsync copy 80 GB too.

    ccelis

  2. #22
    winepress is offline Member
    Join Date
    Nov 2012
    Location
    Seattle, WA, US
    Posts
    14
    Rep Power
    2

    Default

    Hi,

    Just one more bit of info:

    After rsync copies the 80 GB file, "du -sh" will report the NEW file as an 80GB file rather than the original 3.3MB file.

    The post between Quanah and OpenLDAP also appears to confirm the file size / reporting issue.

    However, we're still lacking a solution to the problem. Is this something that can be handled using OpenLDAP rather than Zimbra commands?

    Thanks,
    Kevin

  3. #23
    ccelis5215 is offline Elite Member
    Join Date
    Jun 2011
    Location
    Caracas Venezuela
    Posts
    462
    Rep Power
    4

    Default

    Looking at slapd-mdb .

    Didn`t find a way to "roll" this file......

    maxsize _bytes_
    Specify the maximum size of the database in bytes. A memory map of this size is allocated at startup time and the database will not be allowed to grow beyond this size. The default is 10485760 bytes. This setting may be changed upward if the configured limit needs to be increased.

    Note: It is important to set this to as large a value as possi- ble, (relative to anticipated growth of the actual data over time) since growing the size later may not be practical when the system is under heavy load.

  4. #24
    kevindods is offline Advanced Member
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    9

    Default

    Yep I concur, du -c -h data.mdb on copied file is 81GB not 7MB.

  5. #25
    winepress is offline Member
    Join Date
    Nov 2012
    Location
    Seattle, WA, US
    Posts
    14
    Rep Power
    2

    Default

    Just thought I'd try an intermediate solution of:

    Code:
    zmlocalconfig -e ldap_db_maxsize=67108864
    zmlocalconfig -e ldap_accesslog_maxsize=67108864
    Restarted the services...did NOT change the file size--still 80GB. I was aiming for 64MB.

    It was a long-shot, but worth the try anyway...

  6. #26
    ccelis5215 is offline Elite Member
    Join Date
    Jun 2011
    Location
    Caracas Venezuela
    Posts
    462
    Rep Power
    4

    Default

    Hi all,

    I've filled a RFE Bug 78781 – LDAP data.mdb file allocate 80 GB

    ccelis.

  7. #27
    quanah is offline Zimbra Employee
    Join Date
    May 2007
    Location
    Zimbra
    Posts
    1,271
    Rep Power
    10

    Default

    I suggest running du -c -h on the file. It is not 80GB. 80GB is purely the default maximum amount it can use up to.

    Also, note that the supported method of backing up ldap has been, and always will be via LDIF. That is why zmslapcat exports the database to LDIF. If you are using cp or rsync to back up the LDAP DB, you are applying an incorrect backup methodology.
    Quanah Gibson-Mount
    Server Architect
    Zimbra, Inc
    --------------------
    Zimbra :: the leader in open source messaging and collaboration

  8. #28
    ccelis5215 is offline Elite Member
    Join Date
    Jun 2011
    Location
    Caracas Venezuela
    Posts
    462
    Rep Power
    4

    Default

    Quote Originally Posted by quanah View Post
    I suggest running du -c -h on the file. It is not 80GB. 80GB is purely the default maximum amount it can use up to.

    Also, note that the supported method of backing up ldap has been, and always will be via LDIF. That is why zmslapcat exports the database to LDIF. If you are using cp or rsync to back up the LDAP DB, you are applying an incorrect backup methodology.
    Dear sir,

    As a FOSS user and a small business user, we use the backup strategy /opt/zimbra copy, there's a way to setup this file in installation or maintain according usage?

    Sure there's many users in my situation.

    Thank for your fast response.

    ccelis.

  9. #29
    quanah is offline Zimbra Employee
    Join Date
    May 2007
    Location
    Zimbra
    Posts
    1,271
    Rep Power
    10

    Default

    I would suggest you fix your backup strategy to what OpenLDAP supports. Which is to export the database, via slapcat, to an LDIF file.
    Quanah Gibson-Mount
    Server Architect
    Zimbra, Inc
    --------------------
    Zimbra :: the leader in open source messaging and collaboration

  10. #30
    kevindods is offline Advanced Member
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    9

    Default

    The rsync approach has been part of the recommended process for Zimbra FOSS for a very long time. As someone else has mentioned that this 80GB on copy was not happening in v8 when the DB changed can you suggest why it is happening this time in v8.0.1?With respect if we follow the previous recommendations from Zimbra devs/staff for FOSS and we end up at this current position I would suggest that the guidance offered to us has been incorrect not that our strategy per se is wrong. The tone of your comments suggests you think we are incapable or stupid, which is unfair and unjustified. This current change is only apparent now and it certainly hasn't been the case before.Can you kindly explain why it has been changed to be structured like this so we can understand and perhaps why it has happened without any warning or prior advice.

Page 3 of 12 FirstFirst 12345 ... LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Extending LDAP database
    By frost983 in forum Developers
    Replies: 3
    Last Post: 11-02-2010, 06:46 AM
  2. [SOLVED] Zmsetservername choking on ldap database
    By Emmanuel Kasper in forum Administrators
    Replies: 7
    Last Post: 10-21-2009, 09:50 AM
  3. How do I browse Zimbra LDAP database?
    By williamn in forum Administrators
    Replies: 4
    Last Post: 04-16-2008, 01:47 AM
  4. Replies: 0
    Last Post: 01-14-2008, 11:41 AM
  5. change ldap database
    By Grejao in forum Administrators
    Replies: 1
    Last Post: 12-07-2007, 08:39 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •