Zimbra

etiennepouliot · #1 (**permalink**) 02-18-2011, 12:14 PM

I have 4 Zimbra serveurs in a multi servers setup. 2 are mailbox and 2 are both LDAP and MTA. On one of those mailbox server I have a zmlogger.

The issue that I have is when go to the statistics on Zimbra admin, stats work individually for each serveur but they do not work globally, for all server together. That would be useful to me for example to see on many spam do I get daily in total.

My Zimbra is 6.0.11 ans Linux is CentOS 5.6 on all servers. Syslog is correctly configured on the logger (-r -m 0)

I'm not sure what exacly is wrong, any idea what could I check ?

As recommended by the wiki, here the result of the following commands :

zmloggerctl status; echo $?; ps ax | grep zmlogger :

Quote:

0
14155 ? S 0:11 /usr/bin/perl /opt/zimbra/libexec/zmlogger
14201 ? S 0:00 zmlogger: zmrrdfetch: server
29152 pts/0 S+ 0:00 grep zmlogger

/opt/zimbra/libexec/zmrrdfetch -f zmmtastats :

Quote:

Host: zmua1.example.com

timestamp,mta_delay,sendmail_events
1297785300,,
1297785330,,
1297785360,,
1297785390,,
1297785420,,
1297785450,,
1297785480,,
1297785510,,
1297785540,,
1297785570,,
1297785600,,
1297785630,,
1297785660,,
1297785690,,
1297785720,,
1297785750,,

(removed aobut 5000 lines)

/opt/zimbra/libexec/zmrrdfetch -c -f zmmtastats :

Quote:

Host: zmua1.example.com

timestamp,mta_delay,sendmail_events
1297785600,,
1297785900,,
1297786200,,
1297786500,,
1297786800,,
1297787100,,
1297787400,,
1297787700,,
1297788000,,
1297788300,,
1297788600,,
1297788900,,
1297789200,,
1297789500,,

(Removed about 5000 lines)

grep -w MTA /var/log/zimbra-stats.log :

Quote:

Feb 16 04:10:04 zmua1 zimbramon[22174]: 22174:info: MTA: zmua1.example.com: mta_delay,sendmail_events:: 0,0
Feb 16 04:10:04 zmua1 zimbramon[22174]: 22174:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,2.92857142857143,86049634,0,32,56,12,0
Feb 16 04:10:04 zmua1 zimbramon[22174]: 22174:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,0.777777777777778,29762,0,7,9,7,0
Feb 16 04:20:04 zmua1 zimbramon[2883]: 2883:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,8.61428571428571,1229218,0,39,70,17,0
Feb 16 04:20:04 zmua1 zimbramon[2883]: 2883:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,0,30.5,37456,0,5,10,5,0
Feb 16 04:30:04 zmua1 zimbramon[15952]: 15952:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,8.91228070175439,1334276,0,30,57,12,0
Feb 16 04:30:04 zmua1 zimbramon[15952]: 15952:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,80.2222222222222,21948,0,6,9,6,0
Feb 16 04:40:04 zmua1 zimbramon[29046]: 29046:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,9.73770491803278,6475830,0,38,61,18,0
Feb 16 04:40:04 zmua1 zimbramon[29046]: 29046:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,63.4,15444,0,2,5,2,0
Feb 16 04:50:04 zmua1 zimbramon[9786]: 9786:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,2.0958904109589,1157842,0,50,73,29,0
Feb 16 04:50:04 zmua1 zimbramon[9786]: 9786:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,3.38461538461538,64684,0,10,13,10,0
Feb 16 05:00:04 zmua1 zimbramon[22878]: 22878:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,5.20588235294118,1005512,0,39,68,23,0
Feb 16 05:00:04 zmua1 zimbramon[22878]: 22878:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,2.33333333333333,31538,0,6,9,6,0
Feb 16 05:10:04 zmua1 zimbramon[3553]: 3553:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,5.5177304964539,10919300,0,79,141,27,0
Feb 16 05:10:04 zmua1 zimbramon[3553]: 3553:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,14.5652173913043,82030,0,20,23,19,0
Feb 16 05:20:04 zmua1 zimbramon[16692]: 16692:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,3.36559139784946,4497590,0,60,93,29,0
Feb 16 05:20:04 zmua1 zimbramon[16692]: 16692:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,3.21052631578947,77986,0,12,19,10,0
Feb 16 05:30:05 zmua1 zimbramon[29799]: 29799:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,8.61643835616438,813930,0,55,73,44,0
Feb 16 05:30:05 zmua1 zimbramon[29799]: 29799:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,48.64,57352,0,9,25,8,0
Feb 16 05:40:04 zmua1 zimbramon[10472]: 10472:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,2.61666666666667,1876598,0,37,60,22,0
Feb 16 05:40:04 zmua1 zimbramon[10472]: 10472:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,1.57894736842105,44708,0,11,19,11,0
Feb 16 05:50:04 zmua1 zimbramon[23585]: 23585:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,8.5764705882353,3115774,0,49,85,28,0
Feb 16 05:50:04 zmua1 zimbramon[23585]: 23585:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,0.666666666666667,45312,0,9,15,8,0
Feb 16 06:00:05 zmua1 zimbramon[4335]: 4335:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,5.06730769230769,45453618,0,58,104,20,0
Feb 16 06:00:05 zmua1 zimbramon[4335]: 4335:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,0,4.13333333333333,75762,0,7,15,6,0
Feb 16 06:10:04 zmua1 zimbramon[17411]: 17411:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,4.22222222222222,1836056,0,59,99,29,0
Feb 16 06:10:04 zmua1 zimbramon[17411]: 17411:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,1.23529411764706,57880,0,12,17,12,0
Feb 16 06:20:04 zmua1 zimbramon[30584]: 30584:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,2.59459459459459,2028256,0,47,74,22,0
Feb 16 06:20:04 zmua1 zimbramon[30584]: 30584:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,22.3571428571429,82322,0,19,28,18,0
Feb 16 06:30:04 zmua1 zimbramon[11172]: 11172:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,2,2.8785046728972,2142068,0,68,107,35,0
Feb 16 06:30:04 zmua1 zimbramon[11172]: 11172:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,16.4146341463415,203356,0,32,41,31,0
Feb 16 06:40:04 zmua1 zimbramon[24336]: 24336:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,4.5234375,1418504,0,82,128,44,0
Feb 16 06:40:04 zmua1 zimbramon[24336]: 24336:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,49.04,74636,0,14,25,12,0
Feb 16 06:50:04 zmua1 zimbramon[5089]: 5089:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,5.08571428571429,2855870,0,66,105,35,0
Feb 16 06:50:04 zmua1 zimbramon[5089]: 5089:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,1.18181818181818,114934,0,25,33,21,0
Feb 16 07:00:04 zmua1 zimbramon[18184]: 18184:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,2.46551724137931,4692244,0,77,116,46,0
Feb 16 07:00:04 zmua1 zimbramon[18184]: 18184:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,2.5,130244,0,33,36,33,0
Feb 16 07:10:04 zmua1 zimbramon[31299]: 31299:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,1.35514018691589,3287058,0,71,107,40,0
Feb 16 07:10:04 zmua1 zimbramon[31299]: 31299:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,8.86666666666667,180436,0,40,45,39,0
Feb 16 07:20:04 zmua1 zimbramon[12368]: 12368:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,3.70621468926554,5415538,0,113,177,64,0
Feb 16 07:20:04 zmua1 zimbramon[12368]: 12368:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,18.6571428571429,113420,0,28,35,27,0
Feb 16 07:30:04 zmua1 zimbramon[25620]: 25620:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,3.08035714285714,60675758,0,64,112,21,0
Feb 16 07:30:04 zmua1 zimbramon[25620]: 25620:info: MTA: zldap.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,1.33333333333333,58204,0,13,15,12,0
Feb 16 07:40:04 zmua1 zimbramon[6547]: 6547:info: MTA: zmta.example.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,4.65573770491803,29332768,0,67,122,21,0

(removed about 20 lines)

tail /var/log/zimbra-stats.log :

Quote:

Feb 16 11:07:46 zmua1 mailboxd: INFO [pop3.csv] [] slogger - pop3.csv: timestamp,command,exec_count,exec_ms_avg:: 02/16/2011 11:07:46,AUTH,1,0
Feb 16 11:07:46 zldap zimbramon[28256]: 28256:info: zmstat vm.csv: timestamp, r, b, swpd, free, buff, cache, si, so, bi, bo, in, cs, us, sy, id, wa, st, MemTotal, MemFree, Buffers, Cached, SwapCached, Active, Inactive, HighTotal, HighFree, LowTotal, LowFree, SwapTotal, SwapFree, Dirty, Writeback, AnonPages, Mapped, Slab, PageTables, NFS_Unstable, Bounce, CommitLimit, Committed_AS, VmallocTotal, VmallocUsed, VmallocChunk, HugePages_Total, HugePages_Free, HugePages_Rsvd, Hugepagesize, loadavg:: 02/16/2011 11:07:46, 0, 0, 0, 11600788, 526680, 2876260, 0, 0, 0, 187, 1080, 404, 6, 0, 94, 0, 0, 16497256, 11600788, 526680, 2876260, 0, 2520376, 2027344, 0, 0, 16497256, 11600788, 18546680, 18546680, 4372, 0, 1144612, 57692, 294464, 17004, 0, 0, 26795308, 2342736, 34359738367, 272024, 34359466183, 0, 0, 0, 2048, 0.60
Feb 16 11:07:46 zmta zimbramon[24152]: 24152:info: zmstat vm.csv: timestamp, r, b, swpd, free, buff, cache, si, so, bi, bo, in, cs, us, sy, id, wa, st, MemTotal, MemFree, Buffers, Cached, SwapCached, Active, Inactive, HighTotal, HighFree, LowTotal, LowFree, SwapTotal, SwapFree, Dirty, Writeback, AnonPages, Mapped, Slab, PageTables, NFS_Unstable, Bounce, CommitLimit, Committed_AS, VmallocTotal, VmallocUsed, VmallocChunk, HugePages_Total, HugePages_Free, HugePages_Rsvd, Hugepagesize, loadavg:: 02/16/2011 11:07:46, 0, 0, 0, 3640980, 1201628, 8978824, 0, 0, 0, 279, 1609, 1328, 3, 0, 97, 0, 0, 16497256, 3640980, 1201628, 8978824, 0, 3652728, 7709904, 0, 0, 16497256, 3640980, 18546680, 18546680, 6000, 0, 1181496, 52356, 1430664, 21036, 0, 0, 26795308, 2493168, 34359738367, 272000, 34359466315, 0, 0, 0, 2048, 0.78
Feb 16 11:07:46 zmua2 zimbramon[21971]: 21971:info: zmstat vm.csv: timestamp, r, b, swpd, free, buff, cache, si, so, bi, bo, in, cs, us, sy, id, wa, st, MemTotal, MemFree, Buffers, Cached, SwapCached, Active, Inactive, HighTotal, HighFree, LowTotal, LowFree, SwapTotal, SwapFree, Dirty, Writeback, AnonPages, Mapped, Slab, PageTables, NFS_Unstable, Bounce, CommitLimit, Committed_AS, VmallocTotal, VmallocUsed, VmallocChunk, HugePages_Total, HugePages_Free, HugePages_Rsvd, Hugepagesize, loadavg:: 02/16/2011 11:07:46, 1, 3, 188, 54624, 298040, 5652784, 0, 0, 5788, 4799, 1496, 3066, 19, 2, 73, 7, 0, 16497256, 54624, 298040, 5652784, 0, 10308224, 5753896, 0, 0, 16497256, 54624, 18546680, 18546492, 94532, 224, 10110928, 31292, 307820, 25612, 0, 0, 26795308, 13622104, 34359738367, 274828, 34359463371, 0, 0, 0, 2048, 1.73
Feb 16 11:07:46 zmua1 zimbramon[8124]: 8124:info: zmstat vm.csv: timestamp, r, b, swpd, free, buff, cache, si, so, bi, bo, in, cs, us, sy, id, wa, st, MemTotal, MemFree, Buffers, Cached, SwapCached, Active, Inactive, HighTotal, HighFree, LowTotal, LowFree, SwapTotal, SwapFree, Dirty, Writeback, AnonPages, Mapped, Slab, PageTables, NFS_Unstable, Bounce, CommitLimit, Committed_AS, VmallocTotal, VmallocUsed, VmallocChunk, HugePages_Total, HugePages_Free, HugePages_Rsvd, Hugepagesize, loadavg:: 02/16/2011 11:07:46, 1, 2, 188, 52520, 214704, 5750580, 0, 0, 8510, 5784, 1481, 3202, 9, 1, 82, 7, 0, 16497256, 52520, 214704, 5750580, 0, 10363780, 5716260, 0, 0, 16497256, 52520, 18546680, 18546492, 24796, 0, 10115296, 32780, 290528, 27264, 0, 0, 26795308, 13656432, 34359738367, 274828, 34359463499, 0, 0, 0, 2048, 1.69
Feb 16 11:07:47 zmua2 mailboxd: INFO [pop3.csv] [] slogger - pop3.csv: timestamp,command,exec_count,exec_ms_avg:: 02/16/2011 11:07:47,XOIP,1,0
Feb 16 11:07:47 zmua2 mailboxd: INFO [pop3.csv] [] slogger - pop3.csv: timestamp,command,exec_count,exec_ms_avg:: 02/16/2011 11:07:47,PASS,1,101
Feb 16 11:07:47 zmua2 mailboxd: INFO [pop3.csv] [] slogger - pop3.csv: timestamp,command,exec_count,exec_ms_avg:: 02/16/2011 11:07:47,USER,1,0
Feb 16 11:07:47 zmua2 mailboxd: INFO [pop3.csv] [] slogger - pop3.csv: timestamp,command,exec_count,exec_ms_avg:: 02/16/2011 11:07:47,QUIT,1,0
Feb 16 11:07:47 zmua2 mailboxd: INFO [pop3.csv] [] slogger - pop3.csv: timestamp,command,exec_count,exec_ms_avg:: 02/16/2011 11:07:47,STAT,1,0

zmsoap -z GetLoggerStatsRequest stats/@name=zmmtastats | head -20

Quote: