Page 10 of 12 FirstFirst ... 89101112 LastLast
Results 91 to 100 of 115

Thread: ldap database went from 97meg to 86gig

  1. #91
    bofh is offline Elite Member
    Join Date
    May 2010
    Posts
    272
    Rep Power
    5

    Default

    Well you do have during installation.
    You could easyly determine the actual size of the db and set the new db 10 times higher - jsut to be shure.
    a daily cron job could check size of the sparse/actual size to determine if its nessesary to adjust the db setting.
    that way the max size limit would be adjusted dynamically

    seriisously dont you understand that a 80gig sparsefile has a major impact. only because the limit was set in 8.0 wont help - noone will check every single value of the settings for bad changes - even if they do they wont expect having a file there that size.

    the minimum requirements of 90gig without data have to be documentated - in red big letters. its not trivial its a big deal.
    btw a quick and dirty fix - really reserving that amount of space
    -
    and no you do not need to run db_recover prior rsync if you do a cold backup.
    you backup the hole zimbra installation anyway.

    heres a little note how we really backup (i hope most do that this way)
    so what we do (i dont do it with rsync but our backup software but dont make much difference in the way todo it)
    we backup hot - jsut to get most daty into the backup set - (always incremental of course)
    then shutdown zimbra - backup everything - because of the incremental backup all we need to backup are recent changes and the database files

    time for a hole shutdown backup 90 seconds atm - no need to run anything in advance - the backup is the exact mirror of the server with a shutdown zimbra

    you can even restore such a backup easy on a different testing server, all its needed is one entry in /etc/hosts, prior installation of the same zimbra version just to get apt and some minor syschanges on to it -delete the new installation restore the cold backup - its running
    (of course firewalling the smtp ports or it will send some mails hanging in the queues during backup time)

  2. #92
    quanah is offline Zimbra Employee
    Join Date
    May 2007
    Location
    Zimbra
    Posts
    1,276
    Rep Power
    10

    Default

    What 90GB requirement? The 80GB sparse file is not actually allocated against the disk. I routinely install ZCS8 on a server with a 48GB hard drive with the 80GB maxsize setting with no issue. What is allocated against the disk is the actual size of the DB. And before you try correcting me with regards as to what is or is not required for LDAP and a cold backup in ZCS7 or less, you may want to spend some time doing some research. I've been using OpenLDAP for over a decade. I've been a member of the project team almost as long. It just may be that I have a deeper understanding of how OpenLDAP works than you do.

    In any case, I've no further comments on this. You've been advised of what to do to resolve your issue. What you do with that information is up to you.

    --Quanah
    Quanah Gibson-Mount
    Server Architect
    Zimbra, Inc
    --------------------
    Zimbra :: the leader in open source messaging and collaboration

  3. #93
    GlooM is offline Active Member
    Join Date
    Nov 2009
    Location
    Moscow, Russia
    Posts
    40
    Rep Power
    5

    Question

    Quote Originally Posted by quanah View Post
    I will note that changing the max size is an extremely bad idea, particularly with any release < 8.0.3.
    8.0.3 are ready for download!
    Is the ldap problem fixed in 8.0.3 version ?

  4. #94
    Smakodak is offline Junior Member
    Join Date
    Apr 2011
    Location
    Copenhagen
    Posts
    8
    Rep Power
    4

    Default

    Can anyone explain why there is a difference in file size depending on backup method?

    Backup done with "zmslapcat"
    -rw-r----- 1 zimbra zimbra 266K 2013-03-29 22:35 ldap.bak

    Backup done with "mdb_copy"
    -rw-r--r-- 1 root root 1,1M 2013-03-29 22:10 data.mdb

    Size of directory as per "du"
    du -sh /opt/zimbra/data/ldap/mdb/db/
    1,1M /opt/zimbra/data/ldap/mdb/db/

    Regards Anders

  5. #95
    piit79 is offline Banned
    Join Date
    Sep 2012
    Posts
    2
    Rep Power
    0

    Default

    zmslapcat will create an LDIF backup of the LDAP database (a text file)
    mdb_copy creates a backup in mdb format (a binary file) - just omits all the "holes" in the sparse file (hence the matching size of the data.mdb file created by mdb_copy and the /opt/zimbra/data/ldap/mdb/db/ directory)

    Pete

    Quote Originally Posted by Smakodak View Post
    Can anyone explain why there is a difference in file size depending on backup method?

    Backup done with "zmslapcat"
    -rw-r----- 1 zimbra zimbra 266K 2013-03-29 22:35 ldap.bak

    Backup done with "mdb_copy"
    -rw-r--r-- 1 root root 1,1M 2013-03-29 22:10 data.mdb

    Size of directory as per "du"
    du -sh /opt/zimbra/data/ldap/mdb/db/
    1,1M /opt/zimbra/data/ldap/mdb/db/

    Regards Anders

  6. #96
    piit79 is offline Banned
    Join Date
    Sep 2012
    Posts
    2
    Rep Power
    0

    Default Thank you, Quannah!

    Thanks Quannah for all the information you provided in this thread - I learned something new about LDAP and Zimbra

    I admire your patience and greatly appreciate your helpful approach. All too often highly experienced developers come across as "ignorant" of comments/wishes by us mere users. Not you! You listened, explained and even created some useful tools and improved Zimbra based on the input.

    Kudos.

    Best regards
    Pete

  7. #97
    quanah is offline Zimbra Employee
    Join Date
    May 2007
    Location
    Zimbra
    Posts
    1,276
    Rep Power
    10

    Default

    Thank you! It's always an adventure deploying new technologies.
    Quanah Gibson-Mount
    Server Architect
    Zimbra, Inc
    --------------------
    Zimbra :: the leader in open source messaging and collaboration

  8. #98
    Smakodak is offline Junior Member
    Join Date
    Apr 2011
    Location
    Copenhagen
    Posts
    8
    Rep Power
    4

    Default

    Thanks for responding

    Regards Anders

  9. #99
    GlooM is offline Active Member
    Join Date
    Nov 2009
    Location
    Moscow, Russia
    Posts
    40
    Rep Power
    5

    Default

    Quote Originally Posted by winepress View Post
    Greetings All,

    Using Quanah's suggestions, here are step-by-step instructions of what I did on my system, which worked quite well. Feel free to improve as necessary:

    This is for a 64MB datasize. Please change ldap_db_maxsize and ldap_accesslog_maxsize as necessary to suit your environment.

    As Zimbra User:
    Code:
    # update database size
    zmlocalconfig -e ldap_db_maxsize=67108864
    
    # update log size
    zmlocalconfig -e ldap_accesslog_maxsize=536870912
    
    # allow time for zmconfigd to apply new setting (as suggested by Quanah)
    sleep 90
    
    # stop slapd
    ldap stop
    
    # change to database directory
    cd /opt/zimbra/data/ldap/mdb/db
    
    # backup database
    /opt/zimbra/libexec/zmslapcat /opt/zimbra/data/ldap/mdb/db
    
    # move to .old
    mv data.mdb data.mdb.old
    
    # recreate database with new size and restore from backup
    /opt/zimbra/openldap/sbin/slapadd -q -b "" -F /opt/zimbra/data/ldap/config -l /opt/zimbra/data/ldap/mdb/db/ldap.bak
    
    # start slapd
    ldap start
    
    # archive original
    gzip data.mdb.old
    I hope this helps!

    Thanks,
    Kevin
    Hello!
    I complete this steps, but /opt/zimbra/data/ldap/mdb.prev/db/data.mdb size = 85899345920
    Is mdb.prev backup folder? Can I delete it?

  10. #100
    Bill Brock is offline Outstanding Member
    Join Date
    May 2007
    Location
    Oklahoma
    Posts
    703
    Rep Power
    9

    Default

    Quick question Quanah. I've used cp to backup my server since ZCS5 and now with ZCS7. I shut the server down first then cp -rp the zimbra directory. I have restored successfully from these backups. Your statement that it remains unacceptable for ZCS7 and prior due to BDB has me confused. Since my method appears to work why are you saying it is unacceptable? Restoring in the opposite direction from the copied zimbra directory appears to work. Could you elaborate on unacceptable?

Page 10 of 12 FirstFirst ... 89101112 LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Extending LDAP database
    By frost983 in forum Developers
    Replies: 3
    Last Post: 11-02-2010, 06:46 AM
  2. [SOLVED] Zmsetservername choking on ldap database
    By Emmanuel Kasper in forum Administrators
    Replies: 7
    Last Post: 10-21-2009, 09:50 AM
  3. How do I browse Zimbra LDAP database?
    By williamn in forum Administrators
    Replies: 4
    Last Post: 04-16-2008, 01:47 AM
  4. Replies: 0
    Last Post: 01-14-2008, 11:41 AM
  5. change ldap database
    By Grejao in forum Administrators
    Replies: 1
    Last Post: 12-07-2007, 08:39 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •