Page 1 of 3 123 LastLast
Results 1 to 10 of 26

Thread: 6.0.2 Huge increase in disk usage?

  1. #1
    quietas is offline Elite Member
    Join Date
    Aug 2007
    Location
    Anchorage, AK
    Posts
    376
    Rep Power
    8

    Default 6.0.2 Huge increase in disk usage?

    OK, now what the heck happened after I upgraded from 5.0.18 to 6.0.1 (and now 6.0.2)? The disk usage has gone through the roof. I had been using under 150gigs total and now my usage is at 98% with 363 of 394gb used. I seem to have traced this to the backup folder and it's using far more than previously.

    What happened? How can I fix it? Is this intended? Has no one heard of compression?

    At the rate our mail had been growing, we should have had a couple years before needing new drives, but now we need them immediately and I'm deleting older backup sessions. 60gb of mail currently, but nearly 400gb with backups?
    Culley
    Mail | Dell 2950III | 2x Quad Core 5420 | 8gb RAM | 6x 146gb SAS RAID 0+1 | Red Hat 5.3 | Zimbra 6.0.10 Network Edition
    Test | VMware ESXi Whitebox | Phenom II Black 3.2ghz | 12gb RAM | 6x 1tb SATA RAID 0+1 | CentOS 5.4 | FOSS, Not in use now

  2. #2
    Klug's Avatar
    Klug is offline Moderator
    Join Date
    Mar 2006
    Location
    Beaucaire, France
    Posts
    2,322
    Rep Power
    13

    Default

    6.0 made "-z" default for zmbackup but with no compression.

    This allows backup tools to be able to deal with the backup directory because there are no more hard links.

    But no more hard links means lots of copies of blobs...
    So lots of additional space used.

  3. #3
    Klug's Avatar
    Klug is offline Moderator
    Join Date
    Mar 2006
    Location
    Beaucaire, France
    Posts
    2,322
    Rep Power
    13

    Default

    Additionnal info from Mike : [SOLVED] Compressing blobs in volume

    And maybe you should not store your backups on the same volume/HD than your live data... Why not using an external iSCSI SAN or even an USB HD ?

  4. #4
    quietas is offline Elite Member
    Join Date
    Aug 2007
    Location
    Anchorage, AK
    Posts
    376
    Rep Power
    8

    Default

    I really wish they had put this in the release notes. That and made the text bold flashing and maybe neon. I'm scrambling atm to get some new SAS 1tb drives to make an HSM and replace a couple of my 146gb drives.

    Will Zimbra automatically delete older backups to maintain current backup procedures and also free space for incoming new mail? Or will I need to eliminate older backups manually to free space?
    Culley
    Mail | Dell 2950III | 2x Quad Core 5420 | 8gb RAM | 6x 146gb SAS RAID 0+1 | Red Hat 5.3 | Zimbra 6.0.10 Network Edition
    Test | VMware ESXi Whitebox | Phenom II Black 3.2ghz | 12gb RAM | 6x 1tb SATA RAID 0+1 | CentOS 5.4 | FOSS, Not in use now

  5. #5
    quietas is offline Elite Member
    Join Date
    Aug 2007
    Location
    Anchorage, AK
    Posts
    376
    Rep Power
    8

    Default

    Quote Originally Posted by Klug View Post
    Additionnal info from Mike : [SOLVED] Compressing blobs in volume

    And maybe you should not store your backups on the same volume/HD than your live data... Why not using an external iSCSI SAN or even an USB HD ?
    $$$$ is what it came down to. I would love a SAN, any SAN. No $$$ in my budget for a SAN, I struggle even to have upgrades every 5 years. AD server is from 2002 and running Server 2k for example. As for USB, that is where I am routing the backups now, I set that up this morning as a hold over and my purchasing department is ordering a couple 1TB drives for me supposedly.
    Culley
    Mail | Dell 2950III | 2x Quad Core 5420 | 8gb RAM | 6x 146gb SAS RAID 0+1 | Red Hat 5.3 | Zimbra 6.0.10 Network Edition
    Test | VMware ESXi Whitebox | Phenom II Black 3.2ghz | 12gb RAM | 6x 1tb SATA RAID 0+1 | CentOS 5.4 | FOSS, Not in use now

  6. #6
    Klug's Avatar
    Klug is offline Moderator
    Join Date
    Mar 2006
    Location
    Beaucaire, France
    Posts
    2,322
    Rep Power
    13

    Default

    It is in the release notes.
    •Backup. The default backup now is to backup files as a zip without
    compression. Previous to 6.0, backups were not zipped. (Bug 31836)
    But you're right, the side effect is not 8-((

    ZCS will delete backups as per specified in your backup schedule (30 days by default).

  7. #7
    quietas is offline Elite Member
    Join Date
    Aug 2007
    Location
    Anchorage, AK
    Posts
    376
    Rep Power
    8

    Default

    Yeah, I read zip without compression as copied but not compressed. I realize now that it still would have compressed it and it seems like it did to a significant amount. I wonder if there are plans to implement an On/Off for compression in the future?
    Culley
    Mail | Dell 2950III | 2x Quad Core 5420 | 8gb RAM | 6x 146gb SAS RAID 0+1 | Red Hat 5.3 | Zimbra 6.0.10 Network Edition
    Test | VMware ESXi Whitebox | Phenom II Black 3.2ghz | 12gb RAM | 6x 1tb SATA RAID 0+1 | CentOS 5.4 | FOSS, Not in use now

  8. #8
    cpalsgrove is offline Intermediate Member
    Join Date
    Oct 2008
    Location
    Westminster, Maryland, USA
    Posts
    17
    Rep Power
    6

    Default

    I just modified the zimbra crontab to do the backups without compression and it does it the old way which is working for us.

    0 1 * * 0-5 /opt/zimbra/bin/zmbackup -i --noZip
    0 1 * * 6 /opt/zimbra/bin/zmbackup -f -a all --noZip

  9. #9
    Klug's Avatar
    Klug is offline Moderator
    Join Date
    Mar 2006
    Location
    Beaucaire, France
    Posts
    2,322
    Rep Power
    13

    Default

    Quote Originally Posted by cpalsgrove View Post
    I just modified the zimbra crontab to do the backups without compression and it does it the old way which is working for us.
    crontab might be rewritten by ZCS.

    You should use zmschedulebackup to do changes.
    CLI zmschedulebackup Network Edition only - Zimbra :: Wiki

  10. #10
    cpalsgrove is offline Intermediate Member
    Join Date
    Oct 2008
    Location
    Westminster, Maryland, USA
    Posts
    17
    Rep Power
    6

    Default

    Quote Originally Posted by Klug View Post
    crontab might be rewritten by ZCS.

    You should use zmschedulebackup to do changes.
    CLI zmschedulebackup Network Edition only - Zimbra :: Wiki
    The problem is that zmschedulebackup does not offer a flag for the --noZip option, only compressed and uncompressed zip options. If there is a flag that is not published in the usage notes that will give the --noZip option, I would love to use zmschedulebackup. I'll put in an enhancement request for that flag to be added unless someone can point out something that I'm missing.

Page 1 of 3 123 LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Daily mail report always reports "No messages found"
    By McPringle in forum Installation
    Replies: 42
    Last Post: 06-13-2011, 08:57 AM
  2. weird disk usage and message volume
    By phingers in forum Administrators
    Replies: 9
    Last Post: 07-20-2010, 05:13 AM
  3. [SOLVED] unexpected disk usage growth
    By jwilke in forum Administrators
    Replies: 3
    Last Post: 07-22-2009, 07:48 AM
  4. server statistics for disk usage
    By melody in forum Administrators
    Replies: 2
    Last Post: 03-27-2008, 06:28 AM
  5. Disk Usage doesn't report available
    By Achim.Theobald in forum Installation
    Replies: 3
    Last Post: 06-21-2006, 08:18 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •