[SOLVED] Yet Another Backup Script for Community Version

[heinzg]

Originally Posted by gilus

Hi Heinzg,

Thanks again for fast reply! Indeed it happens only while hotsync (I guess it was because some of the users were still online and working! ;-) Cold sync went without any errors.

Again than You for a great tool! The people like You are the core of the Open Source idea! Thanks for the support and good luck!

Michal

you make me blush ! But Thanx - I hope it helps some people out there, and that is what it is all about free code for all.

Heinzg

[chrishewitt]

Originally Posted by heinzg

Does this help you, Please check this agains your dar files, and let me know. That is if you still have some dar that are crypt.

I didn't have any encrypted files, but I re-enabled encryption and manually ran a FULL backup earlier. I ran the commands shown above on the finished archive with the -K option and it completed okay as per your example. I didn't have a DIFF backup to test against. I noted that if I ran the -K option against a non-encrypted archive it produces the elastic buffer error. If I run the -J option against a non-encrypted archive it completes fine. I think that's what you'd expect - although I don't really understand what you were trying to tell me before. I've not modified any of the dar commands in the script so I'm not sure that helps me/us figure out why the error is thrown when I enable encryption. For now I'm happy to leave it off, it's not really required, but it would be nice to know why it happens (intellectually).

btw.. I've noticed that the log-rotation function moved the archive files when it rolled over the other day, but it didn't move the Backuplist files. Here's the current folder listing:

[root@zim zimbra-backup-current]# ls -l
total 1522412
-rw-r--r-- 1 root root 1472045706 May 12 02:02 19_Zimbra_Backup_12-May-2008_FULL.1.dar
-rw-r--r-- 1 root root 74 May 12 02:55 19_Zimbra_Backup_12-May-2008_FULL.1.dar.md5
-rw-r--r-- 1 root root 26529543 May 13 01:21 19_Zimbra_Backup_13-May-2008_DIFF.1.dar
-rw-r--r-- 1 root root 74 May 13 01:21 19_Zimbra_Backup_13-May-2008_DIFF.1.dar.md5
-rw-r--r-- 1 root root 26910522 May 14 01:26 19_Zimbra_Backup_14-May-2008_DIFF.1.dar
-rw-r--r-- 1 root root 74 May 14 01:26 19_Zimbra_Backup_14-May-2008_DIFF.1.dar.md5
-rw-r--r-- 1 root root 27625378 May 15 01:22 19_Zimbra_Backup_15-May-2008_DIFF.1.dar
-rw-r--r-- 1 root root 74 May 15 01:22 19_Zimbra_Backup_15-May-2008_DIFF.1.dar.md5
-rw-r--r-- 1 root root 530089 May 6 07:42 Backuplist-06-May-2008.txt.gz
-rw-r--r-- 1 root root 476026 May 7 01:21 Backuplist-07-May-2008.txt.gz
-rw-r--r-- 1 root root 476296 May 8 01:21 Backuplist-08-May-2008.txt.gz
-rw-r--r-- 1 root root 476384 May 9 01:21 Backuplist-09-May-2008.txt.gz
-rw-r--r-- 1 root root 476547 May 10 01:21 Backuplist-10-May-2008.txt.gz
-rw-r--r-- 1 root root 476787 May 11 01:22 Backuplist-11-May-2008.txt.gz
-rw-r--r-- 1 root root 530969 May 12 02:56 Backuplist-12-May-2008.txt.gz
-rw-r--r-- 1 root root 477731 May 13 01:22 Backuplist-13-May-2008.txt.gz
-rw-r--r-- 1 root root 477966 May 14 01:26 Backuplist-14-May-2008.txt.gz
-rw-r--r-- 1 root root 478105 May 15 01:22 Backuplist-15-May-2008.txt.gz

You can see the FULL backup is dated the 12th May but the Backuplist files go back to the 6th May..

Christian

[MTecknology]

I get this email when I run the script.

I created a distribution list. I created aliases for all the emails listed in the "To" field to go to that list.

I can't figure out why I'm getting the error about CC address.
"CC: -s@mail.server.com"

I have this in the config file.
EMAIL="zmback@mail.server.com"
EMAILCC=""
LOG="/var/log/zim_backup.log"

Any ideas what's going on?

====== BEGIN EMAIL ======

This is the mail system at host mail.server.com.

I'm sorry to have to inform you that your message could not
be delivered to one or more recipients. It's attached below.

For further assistance, please send mail to postmaster.

If you do so, please include this problem report. You can
delete your own text from the attached returned message.

The mail system

<-s@mail.server.com> (expanded from <-s>): bad address syntax



Reporting-MTA: dns; mail.server.com
X-Postfix-Queue-ID: C0EBFB00C3
X-Postfix-Sender: rfc822; root@mail.server.com
Arrival-Date: Fri, 30 May 2008 15:07:16 -0500 (CDT)

Final-Recipient: rfc822; -s@mail.server.com
Original-Recipient: rfc822; -s
Action: failed
Status: 5.1.3
Diagnostic-Code: X-Postfix; bad address syntax



From:
root@mail.server.com (root)
Date:
Fri, 30 May 2008 15:07:16 -0500 (CDT)
To:
Zimbra@mail.server.com, Services@mail.server.com, Stopped@mail.server.com, on@mail.server.com, vindico.local@mail.server.com, zmback@mail.server.com
CC:
-s@mail.server.com

====== END EMAIL ======

[chrishewitt]

I think this is an error in the script that occurs when you leave the CC blank (see earlier comments in this thread). I never tested it without one myself, so I'm not 100% sure, but I think a blank CC causes the script to compile the email with a leading - on on the main to: email address, which would be an RFC2822 violation for your MTA to disagree with. Adding a CC should solve the problem?

Christian

[MTecknology]

:::::::::::::::::::::::::::::::::::::::::::::::::: ::::::::::::::::::::
Full Zimbra Backup ended at: 16:25
Backup took Hr:0 Min:10 Sec:58 to complete
:::::::::::::::::Cheers Osoffice for the script:::::::::::::::::::::::
/root/zmbac.sh: line 901: /Backup/zimbra_dars/Backuplist-30-May-2008.txt.gz: Permission denied
Null message body; hope that's ok


root@vindico:~# ls -l /Backup/zimbra_dars/
total 466116
-rw-r--r-- 1 root root 476575857 2008-05-30 16:24 21_Zimbra_Backup_30-May-2008_FULL.1.dar
-rw-r--r-- 1 root root 74 2008-05-30 16:25 21_Zimbra_Backup_30-May-2008_FULL.1.dar.md5
-rw-r--r-- 1 root root 241961 2008-05-30 16:25 Backuplist-30-May-2008.txt.gz

I'm not sure what's going on here.

I'm also curious if I need all these extra accounts or not?
Like backup@mail.server.com, error@mail.server.com, on@mail.server.com, services@mail.server.com, stopped@mail.server.com, server.local@mail.server.com, and zimbra@mail.server.com.

This seems like an excess number of accounts needed for backups.

Hope these two questions aren't as stupid as the last one, being as it was answered one page prior.

Thanks,

[chrishewitt]

The permission error doesn't affect the core part of the backup, it occurs during the incremental file-list creation process so you end up with a blank Backuplist file. If you can live with it, it doesn't appear to be anything to worry about. If you can't, the workaround is to disable encryption and it will go away. NB: You only need to use one email address (in to: with the same or a null address in cc: to avoid the error) so I'm not sure why you've thought it required multiple addresses or a DL?

Christian

[heinzg]

Originally Posted by MTecknology

:::::::::::::::::::::::::::::::::::::::::::::::::: ::::::::::::::::::::
Full Zimbra Backup ended at: 16:25
Backup took Hr:0 Min:10 Sec:58 to complete
:::::::::::::::::Cheers Osoffice for the script:::::::::::::::::::::::
/root/zmbac.sh: line 901: /Backup/zimbra_dars/Backuplist-30-May-2008.txt.gz: Permission denied
Null message body; hope that's ok


root@vindico:~# ls -l /Backup/zimbra_dars/
total 466116
-rw-r--r-- 1 root root 476575857 2008-05-30 16:24 21_Zimbra_Backup_30-May-2008_FULL.1.dar
-rw-r--r-- 1 root root 74 2008-05-30 16:25 21_Zimbra_Backup_30-May-2008_FULL.1.dar.md5
-rw-r--r-- 1 root root 241961 2008-05-30 16:25 Backuplist-30-May-2008.txt.gz

I'm not sure what's going on here.

I'm also curious if I need all these extra accounts or not?
Like backup@mail.server.com, error@mail.server.com, on@mail.server.com, services@mail.server.com, stopped@mail.server.com, server.local@mail.server.com, and zimbra@mail.server.com.

This seems like an excess number of accounts needed for backups.

Hope these two questions aren't as stupid as the last one, being as it was answered one page prior.

Thanks,

Hi there,
I will be posting a new script which fixes the cc and the mail log issue this weekend, after doing some more testing
Stay Posted!

Cheers
Heinzg

[chrishewitt]

Originally Posted by heinzg

Hi there, I will be posting a new script which fixes the cc and the mail log issue this weekend, after doing some more testing. Stay Posted!

Hi Heinz, did that ever happen!?

Christian

[heinzg]

hi chrishewitt,

due to the current work load I have, this project has been suffering a bit, sorry.
I have fixed the cc & mail log issues, I am also currently trying to make the whole script more modular, hence so extending features is easier. I have also added pre & post script support. I an thinking of maybe also adding LVM snapshots... Oh I have also fixed my current test script so encryption issue with the log life is also corrected. I would also like to get the promised recover option in the next version.

I have also just rebuilt my test server better and faster disks, so testing will be more fun now.

I hope to post the new scripts soon.

[The Fold]

Hi,

I've put this script into use and it created a full backup as expected but then it gave this error:

/usr/local/bin/zmbac.sh: line 837: [: too many arguments
30_Zimbra_Backup_28-July-2008_FULL.1.dar
30_Zimbra_Backup_28-July-2008_FULL.2.dar
30_Zimbra_Backup_28-July-2008_FULL.3.dar not found!
This should not happen

Although when I checked the folder /opt/backup/zimbra_dars the file it says it can't find is there