Page 2 of 12 FirstFirst 1234 ... LastLast
Results 11 to 20 of 115

Thread: ldap database went from 97meg to 86gig

  1. #11
    phoenix is offline Zimbra Consultant & Moderator
    Join Date
    Sep 2005
    Location
    Vannes, France
    Posts
    23,201
    Rep Power
    56

    Default

    You might like to take a look at this post.
    Regards


    Bill


    Acompli: A new adventure for Co-Founder KevinH.

  2. #12
    kevindods is offline Advanced Member
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    9

    Default

    Hi Bill, thanks - yes that is what we find, disk reported as 80GB but occupying a far fewer MBs. The issue is when you attempt to move or backup then you are shifting 80GB not the X MBs which is a fair overhead on data moves and storage. Question is why does it misreport the file size to the OS and create the problem?

  3. #13
    winepress is offline Member
    Join Date
    Nov 2012
    Location
    Seattle, WA, US
    Posts
    14
    Rep Power
    2

    Default

    Hi Bill,

    Thanks for the link. When I ran du -c -h data.mdb, my db size is actually less than I thought -- 3.3 MB. But like kevindods said, any file operations require 80GB rather than 3.3MB. This is a big problem for backups. Plus, I just updated to 8.0.1 to facilitate a migration to a VM off of actual hardware. For a 3.3MB data file, there's really no need to create a massive virtual disk.

    Thanks,
    Kevin

  4. #14
    samgann is offline Intermediate Member
    Join Date
    Feb 2012
    Posts
    17
    Rep Power
    3

    Default

    When I upgraded to 8.0 from 7.x this didnt happen. From 8.0 to 8.01 was when the problem occured. The db change acording to OpenLDAP Tuning Keys 8.0 - Zimbra :: Wiki was made with 8.0 not 8.01

  5. #15
    phoenix is offline Zimbra Consultant & Moderator
    Join Date
    Sep 2005
    Location
    Vannes, France
    Posts
    23,201
    Rep Power
    56

    Default

    Quote Originally Posted by winepress View Post
    When I ran du -c -h data.mdb, my db size is actually less than I thought -- 3.3 MB. But like kevindods said, any file operations require 80GB rather than 3.3MB.
    No, it doesn't - this is an allocated file size not actual data. Try the following on your current data.mdb and see how long it takes::

    Code:
    time cp data.mdb <new_file_somewhere>
    I'll bet it takes a lot less time than you'd think an 80GB would be for copying.
    Regards


    Bill


    Acompli: A new adventure for Co-Founder KevinH.

  6. #16
    samgann is offline Intermediate Member
    Join Date
    Feb 2012
    Posts
    17
    Rep Power
    3

    Default

    upgrade from 7.x to 8.0 this problem did not happen. From 8.0 to 8.01 is when the problem occured. Acording to this link OpenLDAP Tuning Keys 8.0 - Zimbra :: Wiki this should on happen from 7.x to 8.0

  7. #17
    kevindods is offline Advanced Member
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    9

    Default

    Well I am in the middle of an rsync and it certainly seems to be taking 80GB worth of time copying at the moment - the first copy run it sat at the data.mdb for a lot longer than say 80MB would! I will check it and see again but I am still not sure why it needs to allocate the 80GB? Other people are seeing backup failures too with - I did an rsync for the 7.2 install before the upgrade last night and it was much faster.

  8. #18
    winepress is offline Member
    Join Date
    Nov 2012
    Location
    Seattle, WA, US
    Posts
    14
    Rep Power
    2

    Default

    Hi Bill,

    I'll bet it takes a lot less time than you'd think an 80GB would be for copying.
    It was the rsync AND my backup software that alerted me to the 80GB problem. This is not merely speculation.

    Thanks,
    Kevin

  9. #19
    kevindods is offline Advanced Member
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    9

    Default

    Just ran a copy for the file when the actual size was 7MB - after 60s I decided it probably was copying the full 80GB - checking the du -c -h test-data.mdb file size was 7MB but it was no where near finished copying - 7MB/min is not the disk speed!

  10. #20
    kevindods is offline Advanced Member
    Join Date
    Oct 2005
    Posts
    181
    Rep Power
    9

    Default

    just to note that was time cp /opt/zimbra/data/ldap/mdb/db/data.mdb test-data.mdbRunning on Ubuntu, Ext4 on RAID10 15K drives - 8 cores 16GB RAMHouston - we have problem... as they probably didnt say!Bill: Where can we take this next?

Page 2 of 12 FirstFirst 1234 ... LastLast

Thread Information

Users Browsing this Thread

There are currently 4 users browsing this thread. (0 members and 4 guests)

Similar Threads

  1. Extending LDAP database
    By frost983 in forum Developers
    Replies: 3
    Last Post: 11-02-2010, 06:46 AM
  2. [SOLVED] Zmsetservername choking on ldap database
    By Emmanuel Kasper in forum Administrators
    Replies: 7
    Last Post: 10-21-2009, 09:50 AM
  3. How do I browse Zimbra LDAP database?
    By williamn in forum Administrators
    Replies: 4
    Last Post: 04-16-2008, 01:47 AM
  4. Replies: 0
    Last Post: 01-14-2008, 11:41 AM
  5. change ldap database
    By Grejao in forum Administrators
    Replies: 1
    Last Post: 12-07-2007, 08:39 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •