huge log size

[rmvg]

hello my log have grown to a massive size filled the hard drive infact how do i set zimbra to only use a reasonable amount of space for the log files. Also how do i go about clearing the logs will i lose the stats too. I do not want to upset zimbra but i do need to free up some hard disk space so i can recieve mail agian.

21G ./logger
4.0K ./backup
84K ./ssl
14G ./log

[brian]

Hi rmvg,

The logger directory should only contain the database files and the mysql error file. Make sure the error file logger/db/data/<hostname>.err isn't large, if it has you can safely rotate it.

The logger retention is controlled by 2 config keys stored in ldap. You can reduce the size of the database by reducing the SummaryLifetime to 365 days, since that's all the graphs display anyways.
$ zmprov gcf zimbraLogRawLifetime
zimbraLogRawLifetime: 31d
$ zmprov gcf zimbraLogSummaryLifetime
zimbraLogSummaryLifetime: 730d

The files in the log directory are for the most part are rotated by the application server. These should be dated and you can either compress the older files or delete them if you don't have a need.

-Brian

[rmvg]

hi brain thanks alot for you help i deleted all the dated files from the log dir. there were so many rm choked and i had to use this to remove them all find . -name 'zimbrastats-20060*' | xargs rm

Also i have piles of *bin* files in the logger/db/data dir are these safe to delete? Did not see the .err file that you spoke of however see below.

[root@shoemasters data]# ls -lh
total 21G
-rw-rw----  1 zimbra zimbra  10M Dec 30 17:32 ibdata1
-rw-rw----  1 zimbra zimbra 5.0M Dec 30 17:32 ib_logfile0
-rw-rw----  1 zimbra zimbra 5.0M Nov 26  2005 ib_logfile1
-rw-rw----  1 zimbra zimbra 8.7K Nov 26  2005 localhost-bin.000001
-rw-rw----  1 zimbra zimbra 191K Nov 26  2005 localhost-bin.000002
-rw-rw----  1 zimbra zimbra 661K Nov 27  2005 localhost-bin.000003
-rw-rw----  1 zimbra zimbra 142K Nov 27  2005 localhost-bin.000004
-rw-rw----  1 zimbra zimbra 463K Nov 27  2005 localhost-bin.000005
-rw-rw----  1 zimbra zimbra 123K Nov 27  2005 localhost-bin.000006
-rw-rw----  1 zimbra zimbra  138 Nov 27  2005 localhost-bin.index
drwx------  2 zimbra zimbra 4.0K Nov 26  2005 mysql
-rw-rw----  1 zimbra zimbra 1.9M Nov 28  2005 shoemasters-bin.000001
-rw-rw----  1 zimbra zimbra  28K Nov 29  2005 shoemasters-bin.000002
-rw-rw----  1 zimbra zimbra 145K Nov 29  2005 shoemasters-bin.000003
-rw-rw----  1 zimbra zimbra 832K Nov 29  2005 shoemasters-bin.000004
-rw-rw----  1 zimbra zimbra 169K Nov 29  2005 shoemasters-bin.000005
-rw-rw----  1 zimbra zimbra 172K Nov 29  2005 shoemasters-bin.000006
-rw-rw----  1 zimbra zimbra  88K Nov 29  2005 shoemasters-bin.000007
-rw-rw----  1 zimbra zimbra 8.0K Nov 29  2005 shoemasters-bin.000008
-rw-rw----  1 zimbra zimbra 3.0M Nov 30  2005 shoemasters-bin.000009
-rw-rw----  1 zimbra zimbra 673K Nov 30  2005 shoemasters-bin.000010
-rw-rw----  1 zimbra zimbra 2.3M Nov 30  2005 shoemasters-bin.000011
-rw-rw----  1 zimbra zimbra  28K Nov 30  2005 shoemasters-bin.000012
-rw-rw----  1 zimbra zimbra 3.2M Dec  1  2005 shoemasters-bin.000013
-rw-rw----  1 zimbra zimbra 2.4M Dec  1  2005 shoemasters-bin.000014
-rw-rw----  1 zimbra zimbra 6.9M Dec  5  2005 shoemasters-bin.000015
-rw-rw----  1 zimbra zimbra  13M Dec  6  2005 shoemasters-bin.000016
-rw-rw----  1 zimbra zimbra  21M Dec  7  2005 shoemasters-bin.000017
-rw-rw----  1 zimbra zimbra  20M Dec 11  2005 shoemasters-bin.000018
-rw-rw----  1 zimbra zimbra 914K Dec 11  2005 shoemasters-bin.000019
-rw-rw----  1 zimbra zimbra  28K Dec 11  2005 shoemasters-bin.000020
-rw-rw----  1 zimbra zimbra  11M Dec 13  2005 shoemasters-bin.000021
-rw-rw----  1 zimbra zimbra  23M Dec 14  2005 shoemasters-bin.000022
-rw-rw----  1 zimbra zimbra 907K Dec 14  2005 shoemasters-bin.000023
-rw-rw----  1 zimbra zimbra  33K Dec 14  2005 shoemasters-bin.000024
-rw-rw----  1 zimbra zimbra 2.7M Dec 14  2005 shoemasters-bin.000025
-rw-rw----  1 zimbra zimbra 1.3M Dec 14  2005 shoemasters-bin.000026
-rw-rw----  1 zimbra zimbra 609K Dec 14  2005 shoemasters-bin.000027
-rw-rw----  1 zimbra zimbra 183K Dec 14  2005 shoemasters-bin.000028
-rw-rw----  1 zimbra zimbra 404K Dec 15  2005 shoemasters-bin.000029
-rw-rw----  1 zimbra zimbra 168K Dec 15  2005 shoemasters-bin.000030
-rw-rw----  1 zimbra zimbra 4.8M Dec 15  2005 shoemasters-bin.000031
-rw-rw----  1 zimbra zimbra  13M Dec 16  2005 shoemasters-bin.000032
-rw-rw----  1 zimbra zimbra  35M Dec 22  2005 shoemasters-bin.000033
-rw-rw----  1 zimbra zimbra 116K Dec 22  2005 shoemasters-bin.000034
-rw-rw----  1 zimbra zimbra  33K Dec 22  2005 shoemasters-bin.000035
-rw-rw----  1 zimbra zimbra 276K Dec 22  2005 shoemasters-bin.000036
-rw-rw----  1 zimbra zimbra  29M Dec 29  2005 shoemasters-bin.000037
-rw-rw----  1 zimbra zimbra  46M Jan  9  2006 shoemasters-bin.000038
-rw-rw----  1 zimbra zimbra  19M Jan 11  2006 shoemasters-bin.000039
-rw-rw----  1 zimbra zimbra  14M Jan 13  2006 shoemasters-bin.000040
-rw-rw----  1 zimbra zimbra  36M Jan 20  2006 shoemasters-bin.000041
-rw-rw----  1 zimbra zimbra  11M Jan 21  2006 shoemasters-bin.000042
-rw-rw----  1 zimbra zimbra  23M Jan 24  2006 shoemasters-bin.000043
-rw-rw----  1 zimbra zimbra  21M Jan 26  2006 shoemasters-bin.000044
-rw-rw----  1 zimbra zimbra  18M Jan 27  2006 shoemasters-bin.000045
-rw-rw----  1 zimbra zimbra  21M Jan 30  2006 shoemasters-bin.000046
-rw-rw----  1 zimbra zimbra  41M Feb  3  2006 shoemasters-bin.000047
-rw-rw----  1 zimbra zimbra 4.2K Feb  3  2006 shoemasters-bin.000048
-rw-rw----  1 zimbra zimbra 4.6M Feb  3  2006 shoemasters-bin.000049
-rw-rw----  1 zimbra zimbra  39M Feb  8  2006 shoemasters-bin.000050
-rw-rw----  1 zimbra zimbra 4.8M Feb  8  2006 shoemasters-bin.000051
-rw-rw----  1 zimbra zimbra  21M Feb  9  2006 shoemasters-bin.000052
-rw-rw----  1 zimbra zimbra  16M Feb 10  2006 shoemasters-bin.000053
-rw-rw----  1 zimbra zimbra  43M Feb 15  2006 shoemasters-bin.000054
-rw-rw----  1 zimbra zimbra  19M Feb 17  2006 shoemasters-bin.000055
-rw-rw----  1 zimbra zimbra  23M Feb 19  2006 shoemasters-bin.000056
-rw-rw----  1 zimbra zimbra 547K Feb 19  2006 shoemasters-bin.000057
-rw-rw----  1 zimbra zimbra 3.4M Feb 19  2006 shoemasters-bin.000058
-rw-rw----  1 zimbra zimbra  32K Feb 19  2006 shoemasters-bin.000059
-rw-rw----  1 zimbra zimbra  22M Feb 20  2006 shoemasters-bin.000060
-rw-rw----  1 zimbra zimbra 121K Feb 20  2006 shoemasters-bin.000061
-rw-rw----  1 zimbra zimbra  16M Feb 21  2006 shoemasters-bin.000062
-rw-rw----  1 zimbra zimbra 121K Feb 21  2006 shoemasters-bin.000063
-rw-rw----  1 zimbra zimbra 221K Feb 21  2006 shoemasters-bin.000064
-rw-rw----  1 zimbra zimbra 3.3M Feb 21  2006 shoemasters-bin.000065
-rw-rw----  1 zimbra zimbra 190K Feb 21  2006 shoemasters-bin.000066
-rw-rw----  1 zimbra zimbra 2.6M Feb 21  2006 shoemasters-bin.000067
-rw-rw----  1 zimbra zimbra  29K Feb 21  2006 shoemasters-bin.000068
-rw-rw----  1 zimbra zimbra 498K Feb 21  2006 shoemasters-bin.000069
-rw-rw----  1 zimbra zimbra 1.4K Feb 21  2006 shoemasters-bin.000070
-rw-rw----  1 zimbra zimbra 1.8K Feb 21  2006 shoemasters-bin.000071
-rw-rw----  1 zimbra zimbra 804K Feb 21  2006 shoemasters-bin.000072
-rw-rw----  1 zimbra zimbra 2.1K Feb 21  2006 shoemasters-bin.000073
-rw-rw----  1 zimbra zimbra  99K Feb 21  2006 shoemasters-bin.000074
-rw-rw----  1 zimbra zimbra 1.6M Feb 21  2006 shoemasters-bin.000075
-rw-rw----  1 zimbra zimbra 260K Feb 21  2006 shoemasters-bin.000076
-rw-rw----  1 zimbra zimbra 421K Feb 21  2006 shoemasters-bin.000077
-rw-rw----  1 zimbra zimbra 5.5M Feb 22  2006 shoemasters-bin.000078
-rw-rw----  1 zimbra zimbra 190K Feb 22  2006 shoemasters-bin.000079
-rw-rw----  1 zimbra zimbra 119K Feb 22  2006 shoemasters-bin.000080
-rw-rw----  1 zimbra zimbra  15K Feb 22  2006 shoemasters-bin.000081
-rw-rw----  1 zimbra zimbra 9.8M Feb 23  2006 shoemasters-bin.000082
-rw-rw----  1 zimbra zimbra 593K Feb 23  2006 shoemasters-bin.000083
-rw-rw----  1 zimbra zimbra 4.8M Feb 23  2006 shoemasters-bin.000084
-rw-rw----  1 zimbra zimbra 9.3M Mar  7  2006 shoemasters-bin.000085
-rw-rw----  1 zimbra zimbra 6.8M Mar 16  2006 shoemasters-bin.000086
-rw-rw----  1 zimbra zimbra  32M Mar 17  2006 shoemasters-bin.000087
-rw-rw----  1 zimbra zimbra  25M Mar 19  2006 shoemasters-bin.000088
-rw-rw----  1 zimbra zimbra  48K Mar 19  2006 shoemasters-bin.000089
-rw-rw----  1 zimbra zimbra  29K Mar 19  2006 shoemasters-bin.000090
-rw-rw----  1 zimbra zimbra  88K Mar 19  2006 shoemasters-bin.000091
-rw-rw----  1 zimbra zimbra 165K Mar 19  2006 shoemasters-bin.000092
-rw-rw----  1 zimbra zimbra  64K Mar 19  2006 shoemasters-bin.000093
-rw-rw----  1 zimbra zimbra 381K Mar 19  2006 shoemasters-bin.000094
-rw-rw----  1 zimbra zimbra 202M Mar 30  2006 shoemasters-bin.000095
-rw-rw----  1 zimbra zimbra  28M Apr  2  2006 shoemasters-bin.000096
-rw-rw----  1 zimbra zimbra 197M Apr 20  2006 shoemasters-bin.000097
-rw-rw----  1 zimbra zimbra  91M Apr 30  2006 shoemasters-bin.000098
-rw-rw----  1 zimbra zimbra 152M May 13  2006 shoemasters-bin.000099
-rw-rw----  1 zimbra zimbra 113M May 24  2006 shoemasters-bin.000100
-rw-rw----  1 zimbra zimbra  43M May 28  2006 shoemasters-bin.000101
-rw-rw----  1 zimbra zimbra 7.5K May 28  2006 shoemasters-bin.000102
-rw-rw----  1 zimbra zimbra  828 May 28  2006 shoemasters-bin.000103
-rw-rw----  1 zimbra zimbra 109K May 28  2006 shoemasters-bin.000104
-rw-rw----  1 zimbra zimbra  38M May 30  2006 shoemasters-bin.000105
-rw-rw----  1 zimbra zimbra 169M Jun  4  2006 shoemasters-bin.000106
-rw-rw----  1 zimbra zimbra  27M Jun  5  2006 shoemasters-bin.000107
-rw-rw----  1 zimbra zimbra 9.9M Jun  5  2006 shoemasters-bin.000108
-rw-rw----  1 zimbra zimbra 711M Jun 15  2006 shoemasters-bin.000109
-rw-rw----  1 zimbra zimbra 1.1G Jun 24  2006 shoemasters-bin.000110
-rw-rw----  1 zimbra zimbra 227M Jun 26  2006 shoemasters-bin.000111
-rw-rw----  1 zimbra zimbra 1.1G Jul  3 09:30 shoemasters-bin.000112
-rw-rw----  1 zimbra zimbra 9.8M Jul  3 11:05 shoemasters-bin.000113
-rw-rw----  1 zimbra zimbra  48K Jul  3 11:13 shoemasters-bin.000114
-rw-rw----  1 zimbra zimbra 1.2M Jul  3 11:25 shoemasters-bin.000115
-rw-rw----  1 zimbra zimbra 1.1M Jul  3 11:34 shoemasters-bin.000116
-rw-rw----  1 zimbra zimbra 1.2M Jul  3 11:52 shoemasters-bin.000117
-rw-rw----  1 zimbra zimbra 146M Jul  4 11:47 shoemasters-bin.000118
-rw-rw----  1 zimbra zimbra 1.1G Jul 11 09:16 shoemasters-bin.000119
-rw-rw----  1 zimbra zimbra  26M Jul 11 13:26 shoemasters-bin.000120
-rw-rw----  1 zimbra zimbra 196M Jul 13 07:24 shoemasters-bin.000121
-rw-rw----  1 zimbra zimbra 161K Jul 13 18:27 shoemasters-bin.000122
-rw-rw----  1 zimbra zimbra 499M Jul 26 07:18 shoemasters-bin.000123
-rw-rw----  1 zimbra zimbra 1.1G Aug  6 12:40 shoemasters-bin.000124
-rw-rw----  1 zimbra zimbra 296M Aug  8 23:15 shoemasters-bin.000125
-rw-rw----  1 zimbra zimbra 1.1G Aug 16 06:00 shoemasters-bin.000126
-rw-rw----  1 zimbra zimbra 693M Aug 20 22:00 shoemasters-bin.000127
-rw-rw----  1 zimbra zimbra 741M Aug 25 19:44 shoemasters-bin.000128
-rw-rw----  1 zimbra zimbra  20M Aug 26 08:49 shoemasters-bin.000129
-rw-rw----  1 zimbra zimbra 9.4M Aug 26 18:32 shoemasters-bin.000130
-rw-rw----  1 zimbra zimbra 136K Aug 26 18:33 shoemasters-bin.000131
-rw-rw----  1 zimbra zimbra 249M Sep  4 21:36 shoemasters-bin.000132
-rw-rw----  1 zimbra zimbra  53M Sep  6 07:17 shoemasters-bin.000133
-rw-rw----  1 zimbra zimbra 295M Sep 12 20:27 shoemasters-bin.000134
-rw-rw----  1 zimbra zimbra 166M Sep 15 08:09 shoemasters-bin.000135
-rw-rw----  1 zimbra zimbra 151M Sep 17 10:51 shoemasters-bin.000136
-rw-rw----  1 zimbra zimbra 5.8M Sep 17 13:47 shoemasters-bin.000137
-rw-rw----  1 zimbra zimbra 531K Sep 17 14:06 shoemasters-bin.000138
-rw-rw----  1 zimbra zimbra 378K Sep 17 14:36 shoemasters-bin.000139
-rw-rw----  1 zimbra zimbra 706K Sep 17 14:47 shoemasters-bin.000140
-rw-rw----  1 zimbra zimbra 347K Sep 17 14:52 shoemasters-bin.000141
-rw-rw----  1 zimbra zimbra 2.1M Sep 17 17:21 shoemasters-bin.000142
-rw-rw----  1 zimbra zimbra 1.1G Oct  6 04:40 shoemasters-bin.000143
-rw-rw----  1 zimbra zimbra 513M Oct 11 07:11 shoemasters-bin.000144
-rw-rw----  1 zimbra zimbra 678M Oct 29 10:58 shoemasters-bin.000145
-rw-rw----  1 zimbra zimbra 916M Nov 11 12:03 shoemasters-bin.000146
-rw-rw----  1 zimbra zimbra 1.1G Nov 20 07:30 shoemasters-bin.000147
-rw-rw----  1 zimbra zimbra 450M Nov 23 10:02 shoemasters-bin.000148
-rw-rw----  1 zimbra zimbra 1.1G Nov 30 04:50 shoemasters-bin.000149
-rw-rw----  1 zimbra zimbra 937M Dec  6 07:51 shoemasters-bin.000150
-rw-rw----  1 zimbra zimbra 844M Dec 11 19:32 shoemasters-bin.000151
-rw-rw----  1 zimbra zimbra 1.1G Dec 18 13:20 shoemasters-bin.000152
-rw-rw----  1 zimbra zimbra 648M Dec 22 17:31 shoemasters-bin.000153
-rw-rw----  1 zimbra zimbra 331M Dec 26 19:29 shoemasters-bin.000154
-rw-rw----  1 zimbra zimbra  47M Dec 30 13:56 shoemasters-bin.000155
-rw-rw----  1 zimbra zimbra 6.0M Dec 30 16:57 shoemasters-bin.000156
-rw-rw----  1 zimbra zimbra 8.2M Dec 30 22:44 shoemasters-bin.000157
-rw-rw----  1 zimbra zimbra 3.9K Dec 30 17:32 shoemasters-bin.index
drwx------  2 zimbra zimbra 4.0K Nov 26  2005 test
drwx------  2 zimbra zimbra 4.0K May 28  2006 zimbra_logger

[brian]

The ZCS logger doesn't ship with binary logs enabled by default, so if you've enabled them via the log_bin setting in /opt/zimbra/conf/my.logger.cnf you'll also want to set expire_logs_days to something reasonable so your binary logs don't grow without bounds.

[rmvg]

Thanks again i have run into some other snags with Zimbra have been putting off the upgrade to zcs-3.1.4_GA_518.FC3.tgz so now would be a good time to do it. I believe this is the last version of zimbra that will intall on fedora core 3 and i will not be upgrading to a new os until i get some new hardware.

Anywho I will be doing the upgrade today and need to take a backup but need hard drive space i found this file

-rw-rw---- 1 zimbra zimbra 14G Jan 1 17:10 logger_myslow.log

Is this file safe to rotate? Also how do i go about rotating zimbra log files? Also you mentioned some settings in the my.logger.cnf how do i prevent the logger_myslow.log and other log files from getting this large again?

The ZCS logger doesn't ship with binary logs enabled by default, so if you've enabled them via the log_bin setting in /opt/zimbra/conf/my.logger.cnf you'll also want to set expire_logs_days to something reasonable so your binary logs don't grow without bounds.

[brian]

logger_myslow.log is rotated by /etc/logrotate.d/zimbra entry. I don't recall if this is in the 3.1.x releases, if it isn't you can append this to zimbra logrotate.d file.

/opt/zimbra/log/logger_myslow.log {
        daily
        missingok
        notifempty
        create 0660 zimbra zimbra
        compress
        size 5000k
        rotate 3
}