Problems with Statistics

[prahn]

Hi!

I just setup my first Zimbra system, based on Ubuntu 10.04 64-bit and ZCS 7.0. Install was pretty straightforward and I already migrated a lot of mail with imapsync from our current IMAP mailserver.

After some hours of operation, the statistics pages in the admin console stopped working. All services now have a red cross, and when trying to open the pages with the graphical data, I receive an error: Unable to read logger stats. service.FAILURE Method: unknown Details:soap:Receiver

"zmcontrol status" shows all services working!
When I have a look in the syslog file, I see veeeeeery much logging data, to me it looks like all the data, that should go in the statistics now go in the syslog-file:

Feb 16 22:05:30 zimbra zimbramon[2651]: 2651:info: zmstat proc.csv: timestamp, system, user, sys, idle, iowait, mailbox, mailbox-total-cpu, mailbox-utime, mailbox-stime, mailbox-totalMB, mailbox-rssMB, mailbox-sharedMB, mailbox-process-count, mysql, mysql-total-cpu, mysql-utime, mysql-stime, mysql-totalMB, mysql-rssMB, mysql-sharedMB, mysql-process-count, convertd, convertd-total-cpu, convertd-utime, convertd-stime, convertd-totalMB, convertd-rssMB, convertd-sharedMB, convertd-process-count, ldap, ldap-total-cpu, ldap-utime, ldap-stime, ldap-totalMB, ldap-rssMB, ldap-sharedMB, ldap-process-count, postfix, postfix-total-cpu, postfix-utime, postfix-stime, postfix-totalMB, postfix-rssMB, postfix-sharedMB, postfix-process-count, amavis, amavis-total-cpu, amavis-utime, amavis-stime, amavis-totalMB, amavis-rssMB, amavis-sharedMB, amavis-process-:::7C94E172-3A10-11E0-9BEA-1DD0494F19ED::: 
Feb 16 22:05:30 zimbra zimbramon[2651]: :::7C94E172-3A10-11E0-9BEA-1DD0494F19ED:::count, clam, clam-total-cpu, clam-utime, clam-stime, clam-totalMB, clam-rssMB, clam-sharedMB, clam-process-count, zmstat, zmstat-total-cpu, zmstat-utime, zmstat-stime, zmstat-totalMB, zmstat-rssMB, zmstat-sharedMB, zmstat-process-count:: 02/16/2011 22:05:30, system, 0.0, 0.1, 99.9, 0.0, mailbox, 0.0, 0.0, 0.0, 1103.9, 637.9, 5.6, 1, mysql, 0.0, 0.0, 0.0, 907.0, 96.9, 2.9, 1, convertd, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0, ldap, 0.0, 0.0, 0.0, 347.2, 15.9, 3.5, 1, postfix, 0.0, 0.0, 0.0, 47.1, 2.3, 1.7, 6, amavis, 0.0, 0.0, 0.0, 215.4, 51.7, 2.0, 11, clam, 0.0, 0.0, 0.0, 181.3, 134.7, 5.4, 2, zmstat, 0.0, 0.0, 0.0, 6.1, 0.3, 0.2, 14 
Feb 16 22:05:37 zimbra zimbramon[2653]: 2653:info: zmstat cpu.csv: timestamp, cpu:user, cpu:nice, cpu:sys, cpu:idle, cpu:iowait, cpu:irq, cpu:softirq, cpu0:user, cpu0:nice, cpu0:sys, cpu0:idle, cpu0:iowait, cpu0:irq, cpu0:softirq, cpu1:user, cpu1:nice, cpu1:sys, cpu1:idle, cpu1:iowait, cpu1:irq, cpu1:softirq:: 02/16/2011 22:05:37, 0.4, 0.0, 0.1, 99.6, 0.0, 0.0, 0.0, 0.4, 0.0, 0.1, 99.5, 0.0, 0.0, 0.0, 0.4, 0.0, 0.0, 99.6, 0.0, 0.0, 0.0 
Feb 16 22:05:40 zimbra zimbramon[2661]: 2661:info: zmstat io.csv: timestamp, sda:tps, sda:kB_read/s, sda:kB_wrtn/s, sda:kB_read, sda:kB_wrtn:: 02/16/2011 22:05:40, 2.83, 0.13, 19.60, 4, 588 
Feb 16 22:05:40 zimbra zimbramon[2657]: 2657:info: zmstat io-x.csv: timestamp, sda:rrqm/s, sda:wrqm/s, sda:r/s, sda:w/s, sda:rkB/s, sda:wkB/s, sda:avgrq-sz, sda:avgqu-sz, sda:await, sda:svctm, sda:%util:: 02/16/2011 22:05:40, 0.00, 2.17, 0.03, 2.80, 0.13, 19.60, 13.93, 0.00, 1.06, 0.71, 0.20 
Feb 16 22:05:46 zimbra zimbramon[2671]: 2671:info: zmstat mtaqueue.csv: timestamp, KBytes, requests:: 02/16/2011 22:05:46, 0, 0 
Feb 16 22:05:47 zimbra zimbramon[3075]: 3075:info: zmstat fd.csv: timestamp, fd_count, mailboxd_fd_count:: 02/16/2011 22:05:47, 3296, 1174 
Feb 16 22:05:48 zimbra zimbramon[2655]: 2655:info: zmstat vm.csv: timestamp, r, b, swpd, free, buff, cache, si, so, bi, bo, in, cs, us, sy, id, wa, MemTotal, MemFree, Buffers, Cached, SwapCached, Active, Inactive, Active(anon), Inactive(anon), Active(file), Inactive(file), Unevictable, Mlocked, SwapTotal, SwapFree, Dirty, Writeback, AnonPages, Mapped, Shmem, Slab, SReclaimable, SUnreclaim, KernelStack, PageTables, NFS_Unstable, Bounce, WritebackTmp, CommitLimit, Committed_AS, VmallocTotal, VmallocUsed, VmallocChunk, HardwareCorrupted, HugePages_Total, HugePages_Free, HugePages_Rsvd, HugePages_Surp, Hugepagesize, DirectMap4k, DirectMap2M, loadavg:: 02/16/2011 22:05:48, 0, 0, 708688, 202524, 57828, 161328, 0, 0, 0, 25, 215, 393, 0, 0, 100, 0, 2057672, 202524, 57828, 161328, 147596, 1221300, 516356, 1084236, 434304, 137064, 82052, 0, 0, 43059:::871DE292-3A10-11E0-9425-21D0494F19ED::: 
Feb 16 22:05:48 zimbra zimbramon[2655]: :::871DE292-3A10-11E0-9425-21D0494F19ED:::12, 3597224, 208, 0, 1487516, 33076, 32, 44592, 32148, 12444, 2176, 15520, 0, 0, 0, 5334748, 3755804, 34359738367, 275768, 34359459240, 0, 0, 0, 0, 0, 2048, 10240, 2086912, 0.04 
Feb 16 22:05:53 zimbra zimbramon[2669]: 2669:info: zmstat convertd.csv: timestamp, utime, stime, cputime, rchar, wchar, read_bytes, write_bytes, rss, processes, threads:: 02/16/2011 22:05:53, 0, 0, 0, 0, 0, 0, 0, 1888, 6, 6

When looking in /opt/zimbra/log/mailbox.log I see Java errors like this:

2011-02-16 22:04:03,775 INFO  [btpool0-36://zimbra:7071/service/admin/soap/GetLoggerStatsRequest] [name=admin@zimbra.koellernowak.de;mid=1;ip=192.168.4.8;ua=ZimbraWebClient - SAF3 (Mac);] soap - GetLoggerStatsRequest
2011-02-16 22:04:03,775 INFO  [btpool0-36://zimbra:7071/service/admin/soap/GetLoggerStatsRequest] [name=admin@zimbra.koellernowak.de;mid=1;ip=192.168.4.8;ua=ZimbraWebClient - SAF3 (Mac);] SoapEngine - handler exception
com.zimbra.common.service.ServiceException: system failure: Unable to read logger stats
ExceptionId:btpool0-36://zimbra:7071/service/admin/soap/GetLoggerStatsRequest:1297890243775:49aa10751219ed5e
Code:service.FAILURE
	at com.zimbra.common.service.ServiceException.FAILURE(ServiceException.java:248)
	at com.zimbra.cs.service.admin.GetLoggerStats.execfetch(GetLoggerStats.java:451)
	at com.zimbra.cs.service.admin.GetLoggerStats.fetchColumnData(GetLoggerStats.java:266)
	at com.zimbra.cs.service.admin.GetLoggerStats.handle(GetLoggerStats.java:173)
	at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:401)
	at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:276)
	at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:157)
	at com.zimbra.soap.SoapServlet.doWork(SoapServlet.java:294)
	at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:215)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
	at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:208)
	at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
	at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1166)
	at com.zimbra.cs.servlet.SetHeaderFilter.doFilter(SetHeaderFilter.java:79)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
	at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
	at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
	at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
	at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
	at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:218)
	at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
	at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
	at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:422)
	at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
	at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.handler.DebugHandler.handle(DebugHandler.java:77)
	at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
	at org.mortbay.jetty.Server.handle(Server.java:326)
	at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:543)
	at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:946)
	at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
	at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
	at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
	at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
	at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:451)
Caused by: java.net.ConnectException: Connection refused
	at java.net.PlainSocketImpl.socketConnect(Native Method)
	at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
	at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
	at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
	at java.net.Socket.connect(Socket.java:529)
	at java.net.Socket.connect(Socket.java:478)
	at java.net.Socket.<init>(Socket.java:375)
	at java.net.Socket.<init>(Socket.java:218)
	at com.zimbra.cs.service.admin.GetLoggerStats.execfetch(GetLoggerStats.java:392)
	... 37 more

Does anybody have an idea, how to fix that?
Are this two different errors, or do they belong to each other?

After installation I edited the file /etc/default/syslogd as told in the Quick Start manual, but after adding "-r" it only reads like this:
SYSLOGD="-r"

Is there anymore config for syslog to do?

[prahn]

Could no one help me with my problems?
Does nobody have an idea??

:-(

[Joshuar]

Hi,

i am getting into the same error and stats still not working. Any hints to solve this error?

BR,
Josh