ZCS 7 statistics stale - zmrrdfetch bug?

[odilneto]

Hi everybody,

I'm starting a new thread since most of the similar problems seem to have been detected on previous versions of ZCS.

I'm using ZCS 7 Ubuntu 64 and my statistics are stale. The behaviour of the server is somewhat similar to this thread but persists on ZCS7.
What works:
1) General stats: "advanced stats" (except zmmtastats and zmstatuslog)
1.1) Message count, message volume and av/as activity do show up for last 30, 60 and 365 days but data is inaccurate.
2) Site specific stats: disk stats, sessions, mailbox quotas.

All the remaning tabs and stats show "no data available".

As per Wiki, debug data follows.

1) zmloggerctl status; echo $?; ps ax | grep zmlogger
0
1932 ? S 0:02 /usr/bin/perl /opt/zimbra/libexec/zmlogger
2189 ? S 0:00 zmlogger: zmrrdfetch: server
25292 pts/0 R+ 0:00 grep zmlogger

2) /opt/zimbra/libexec/zmrrdfetch -f zmmtastats
Use of uninitialized value $columns[1] in join or string at /opt/zimbra/libexec/zmrrdfetch line 154.
Use of uninitialized value $columns[2] in join or string at /opt/zimbra/libexec/zmrrdfetch line 154.
Use of uninitialized value $columns[3] in join or string at /opt/zimbra/libexec/zmrrdfetch line 154.
[... repeats 58 times]
Host: zimbra.cvj.sc.gov.br
timestamp,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, ,,,,,,,,,,,,,,,,,,mta_count,clam_events,mta_delay, mta_volume
1305084270,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, ,,,,,,,,,,,,,,,,,,,,,,
1305084300,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, ,,,,,,,,,,,,,,,,,,,,,,
1305084330,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, ,,,,,,,,,,,,,,,,,,,,,,
[... repeats hundreds of times]

3) /opt/zimbra/libexec/zmrrdfetch -c -f zmmtastats
SAME AS PREVIOUS

4) grep -w MTA /var/log/zimbra-stats.log
May 11 06:30:05 zimbra zimbramon[19073]: 19073:info: MTA: zimbra.cvj.sc.gov.br: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,0,11.375,251237,0,8,16,0,0
May 11 06:40:06 zimbra zimbramon[22025]: 22025:info: MTA: zimbra.cvj.sc.gov.br: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,16.3333333333333,153949,0,6,12,0,0
May 11 06:50:05 zimbra zimbramon[24848]: 24848:info: MTA: zimbra.cvj.sc.gov.br: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,16.8125,60176041,0,6,16,0,0
May 11 07:00:05 zimbra zimbramon[27634]: 27634:info: MTA: zimbra.cvj.sc.gov.br: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,8.08333333333333,99423,0,6,12,0,0
May 11 07:10:05 zimbra zimbramon[30446]: 30446:info: MTA: zimbra.cvj.sc.gov.br: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,0,22,93844,0,2,4,0,0
May 11 07:20:05 zimbra zimbramon[827]: 827:info: MTA: zimbra.cvj.sc.gov.br: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,25.3333333333333,138549,0,6,9,3,0
[...repeats few more times]

5) tail /var/log/zimbra-stats.log
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: antivirus: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: ldap: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: logger: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: mailbox: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: memcached: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: mta: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: snmp: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: spell: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: stats: Running
May 12 00:28:06 zimbra zimbramon[13727]: 13727:info: 2011-05-12 00:28:01, STATUS: zimbra.cvj.sc.gov.br: zmconfigd: Running

6) zmsoap -z GetLoggerStatsRequest stats/@name=zmmtastats | head -20
<GetLoggerStatsResponse xmlns="urn:zimbraAdmin">
<hostname hn="zimbra.cvj.sc.gov.br">
<stats name="zmmtastats"/>
</hostname>
</GetLoggerStatsResponse>

7) zmsoap -z GetLoggerStatsRequest stats/@name=zmmtastats @limit=1 | head -50

<GetLoggerStatsResponse xmlns="urn:zimbraAdmin">
<hostname hn="zimbra.cvj.sc.gov.br">
<stats name="zmmtastats"/>
</hostname>
</GetLoggerStatsResponse>

IMPORTANT: While trying to fix this issue, i've replaced /opt/zimbra/libexec/zmrrsfetch with the second file provided on bug 41301 which is also attached to this post. Before that, none of the stats were working.

Would really appreciate some help.

Regards.
Odil