[SOLVED] After install server status shows errors for all services

[Rogerl]

I have found that the zimbra part of syslog-ng.conf have some errors.

The "source zimbra_src {" statement have syntax error.
So fist I corrected this line so I could start syslog-ng, but there was still status problem, for ex. the red X.

what I did find was that if I remake/delete the "source zimbra_src {" line.

and change the log line from:
log { source(zimbra_src);

to
log { source(s_all);

s_all = is the default source profile in my configfile

And then I did restart of syslog-ng
/etc/init.d/syslog-ng restart

And now i get "status"-text in the log file.

grep "STATUS" /var/log/zimbra-stats.log | grep stats | head -n10

and the red X has change to blue makers now.

I hope this will also help you.

Regards,
//Roger

[Oded Arbel]

Thanks Rogerl !

I changed the syslog-ng configuration as you described (the default source on my CentOS 5.4 system is s_sys) and now I get a log of status messages on the zimbra logs and the "Server Statistics" page no longer shows error messages.

After about 5 minutes since the change, the "Server Status" page also turned blue - it was not immediate.

But now it is fixed! apparently the problem is simply the syslog-ng configuration. I'll go an open a bug about it.

[Oded Arbel]

I opened Zimbra Bugzilla bug #44280 for this issue.

[edtrick]

Originally Posted by Rogerl

I have found that the zimbra part of syslog-ng.conf have some errors.

The "source zimbra_src {" statement have syntax error.
So fist I corrected this line so I could start syslog-ng, but there was still status problem, for ex. the red X.

what I did find was that if I remake/delete the "source zimbra_src {" line.

and change the log line from:
log { source(zimbra_src);

to
log { source(s_all);

s_all = is the default source profile in my configfile

And then I did restart of syslog-ng
/etc/init.d/syslog-ng restart

And now i get "status"-text in the log file.

grep "STATUS" /var/log/zimbra-stats.log | grep stats | head -n10

and the red X has change to blue makers now.

I hope this will also help you.

Regards,
//Roger

I didn't use syslog-ng. how can I fix in syslog.conf ??
Thanks.

[Oded Arbel]

I don't know - can you attach your syslog.conf file?

[p_nyet]

I'm getting same problem few days ago,
I'm tried to check any advice from this thread, but my problem doesn't solve.
Today I've check permission files on /opt/zimbra/zmstats, and some files owned by root:

drwxr-x--- 2 zimbra zimbra 4096 Mar 26 00:02 2010-03-25
drwxr-x--- 2 zimbra zimbra 4096 Mar 27 00:00 2010-03-26
drwxr-xr-x 2 root root 4096 Mar 28 00:00 2010-03-27
drwxr-xr-x 2 root root 4096 Mar 29 00:00 2010-03-28
drwxr-xr-x 2 root root 4096 Mar 30 00:00 2010-03-29
drwxr-xr-x 2 root root 4096 Mar 31 00:00 2010-03-30
drwxr-xr-x 2 root root 4096 Mar 31 09:45 2010-03-31
-rw-r----- 1 zimbra zimbra 20394059 Mar 27 23:59 allprocs.csv
-rw-r----- 1 zimbra zimbra 372589 Mar 27 23:59 cpu.csv
-rw-r----- 1 zimbra zimbra 59243 Mar 27 23:50 df.csv
-rw-r--r-- 1 root root 6370 Mar 31 11:25 fd.csv

I think permission file is problem there, because:

/opt/zimbra/zmstat/mtaqueue.csv was stale (2010-03-27) pre-rotating
sh: /opt/zimbra/zmstat//2010-03-27/mtaqueue.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/mtaqueue.csv to /opt/zimbra/zmstat//2010-03-27/mtaqueue.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/io.csv was stale (2010-03-27) pre-rotating
sh: /opt/zimbra/zmstat//2010-03-27/io.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/io.csv to /opt/zimbra/zmstat//2010-03-27/io.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/allprocs.csv was stale (2010-03-27) pre-rotating
sh: /opt/zimbra/zmstat//2010-03-27/allprocs.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/allprocs.csv to /opt/zimbra/zmstat//2010-03-27/allprocs.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/df.csv was stale (2010-03-27) pre-rotating
sh: /opt/zimbra/zmstat//2010-03-27/df.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/df.csv to /opt/zimbra/zmstat//2010-03-27/df.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
zmstat-mysql.pid: Already running as pid 9669
/opt/zimbra/zmstat/mysql.csv was stale (2010-03-27) pre-rotating
sh: /opt/zimbra/zmstat//2010-03-27/mysql.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/mysql.csv to /opt/zimbra/zmstat//2010-03-27/mysql.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
Warning: Not possible to monitor process stats
/opt/zimbra/zmstat/proc.csv was stale (2010-03-27) pre-rotating
sh: /opt/zimbra/zmstat//2010-03-27/proc.csv.gz: Permission denied

Ok, now I'm tried to change ownership:
as root:
# chown -R zimbra.zimbra /opt/zimbra/zmstat/

and, as zimbra:
$ zmstatctl start
$ zmstatctl status

Running: zmstat-cpu
Running: zmstat-proc
Running: zmstat-vm
Running: zmstat-fd
Running: zmstat-allprocs
Running: zmstat-mysql
Running: zmstat-io
Running: zmstat-mtaqueue
Running: zmstat-df
Running: zmstat-io-x

Not sure?
$ zmcontrol status
$ zmcontrol status
Host mail.lerindro.co.id
antispam Running
antivirus Running
ldap Running
logger Running
mailbox Running
memcached Running
mta Running
snmp Running
spell Running
stats Running

Now open zimbra administration panel and see server status, stats running well...

[gmcookie]

Folks,

A lot of people seem to be having this problem (including us). Since this problem is not really "solved" in this thread, here is the complete package of information requested in your referenced document (http://wiki.zimbra.com/index.php?tit...and_later%29):

I hope this is enough detail to help nail this.

Statistics show no data available

1. zmloggerctl status; echo $?; ps ax | grep zmlogger :

$ zmloggerctl status; echo $?; ps ax | grep zmlogger
0
11194 ? S 0:05 /usr/bin/perl /opt/zimbra/libexec/zmlogger
11332 ? S 0:00 zmlogger: zmrrdfetch: server
18210 pts/0 R+ 0:00 grep zmlogger

2. # /opt/zimbra/libexec/zmrrdfetch -f zmmtastats

$ /opt/zimbra/libexec/zmrrdfetch -f zmmtastats


Host: zmail.foobar.com

timestamp,filter_misc,clam_events,mta_delay,mta_vo lume,filter_virus,filter_count,mta_count,filter_sp am,sendmail_events
1289241720,,,,,,,,,
1289241750,,,,,,,,,
1289241780,,,,,,,,,
1289241810,,,,,,,,,
1289241840,,,,,,,,,
...

2880 more lines like the above

3. /opt/zimbra/libexec/zmrrdfetch -c -f zmmtastats

/opt/zimbra/libexec/zmrrdfetch -c -f zmmtastats


Host: zmail.foobar.com

timestamp,filter_misc,clam_events,mta_delay,mta_vo lume,filter_virus,filter_count,mta_count,filter_sp am,sendmail_events
1289241900,,,,,,,,,
1289242200,,,,,,,,,
1289242500,,,,,,,,,
1289242800,,,,,,,,,
...
285 more lines like the above

4. grep -w MTA /var/log/zimbra-stats.log

grep -w MTA /var/log/zimbra-stats.log

Nov 9 04:10:09 zmail100 zimbramon[19371]: 19371:info: MTA: zmail.foobar.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,0,0,0,0,0,0,0,0
Nov 9 04:20:07 zmail100 zimbramon[30006]: 30006:info: MTA: zmail.foobar.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,1,434,0,0,1,0,0
Nov 9 04:30:07 zmail100 zimbramon[8784]: 8784:info: MTA: zmail.foobar.com: filter_misc,clam_events,mta_delay,mta_volume,filte r_virus,filter_count,mta_count,filter_spam,sendmai l_events:: 0,1,0,434,0,0,1,0,0
...

37 more lines like the above

5. tail /var/log/zimbra-stats.log

tail /var/log/zimbra-stats.log

Nov 9 10:49:30 zmail100 zimbramon[9493]: 9493:info: :::1623DA3C-EC32-11DF-A48C-B3CF5ABBF662:::, Com_purge_before_date, Com_rename_table, Com_repair, Com_replace, Com_replace_select, Com_reset, Com_restore_table, Com_revoke, Com_revoke_all, Com_rollback, Com_savepoint, Com_select, Com_set_option, Com_show_binlog_events, Com_show_binlogs, Com_show_charsets, Com_show_collations, Com_show_column_types, Com_show_create_db, Com_show_create_table, Com_show_databases, Com_show_errors, Com_show_fields, Com_show_grants, Com_show_innodb_status, Com_show_keys, Com_show_logs, Com_show_master_status, Com_show_ndb_status, Com_show_new_master, Com_show_open_tables, Com_show_privileges, Com_show_processlist, Com_show_slave_hosts, Com_show_slave_status, Com_show_status, Com_show_storage_engines, Com_show_tables, Com_show_triggers, Com_show_variables, Com_show_warnings, Com_slave_start, Com_slave_sto:::163981B6-EC32-11DF-A48C-B3CF5ABBF662:::
Nov 9 10:49:30 zmail100 zimbramon[9493]: 9493:info: :::163981B6-EC32-11DF-A48C-B3CF5ABBF662::, Com_stmt_close, Com_stmt_execute, Com_stmt_fetch, Com_stmt_prepare, Com_stmt_reset, Com_stmt_send_long_data, Com_truncate, Com_unlock_tables, Com_update, Com_update_multi, Com_xa_commit, Com_xa_end, Com_xa_prepare, Com_xa_recover, Com_xa_rollback, Com_xa_start, Compression, Connections, Created_tmp_disk_tables, Created_tmp_files, Created_tmp_tables, Delayed_errors, Delayed_insert_threads, Delayed_writes, Flush_commands, Handler_commit, Handler_delete, Handler_discover, Handler_prepare, Handler_read_first, Handler_read_key, Handler_read_next, Handler_read_prev, Handler_read_rnd, Handler_read_rnd_next, Handler_rollback, Handler_savepoint, Handler_savepoint_rollback, Handler_update, Handler_write, Innodb_buffer_pool_pages_data, Innodb_buffer_pool_pages_dirty, Innodb_buffer_pool_pages_flush:::163987F6-EC32-11DF-A48C-B3CF5ABBF662:::
Nov 9 10:49:30 zmail100 zimbramon[9493]: 9493:info: :::163987F6-EC32-11DF-A48C-B3CF5ABBF662:::ed, Innodb_buffer_pool_pages_free, Innodb_buffer_pool_pages_misc, Innodb_buffer_pool_pages_total, Innodb_buffer_pool_read_ahead_rnd, Innodb_buffer_pool_read_ahead_seq, Innodb_buffer_pool_read_requests, Innodb_buffer_pool_reads, Innodb_buffer_pool_wait_free, Innodb_buffer_pool_write_requests, Innodb_data_fsyncs, Innodb_data_pending_fsyncs, Innodb_data_pending_reads, Innodb_data_pending_writes, Innodb_data_read, Innodb_data_reads, Innodb_data_writes, Innodb_data_written, Innodb_dblwr_pages_written, Innodb_dblwr_writes, Innodb_log_waits, Innodb_log_write_requests, Innodb_log_writes, Innodb_os_log_fsyncs, Innodb_os_log_pending_fsyncs, Innodb_os_log_pending_writes, Innodb_os_log_written, Innodb_page_size, Innodb_pages_created, Innodb_pages_read, Innodb_pages_written, Innodb_row_lock_current_wai:::16398F12-EC32-11DF-A48C-B3CF5ABBF662:::
Nov 9 10:49:30 zmail100 zimbramon[9493]: 9493:info: :::16398F12-EC32-11DF-A48C-B3CF5ABBF662:::ts, Innodb_row_lock_time, Innodb_row_lock_time_avg, Innodb_row_lock_time_max, Innodb_row_lock_waits, Innodb_rows_deleted, Innodb_rows_inserted, Innodb_rows_read, Innodb_rows_updated, Key_blocks_not_flushed, Key_blocks_unused, Key_blocks_used, Key_read_requests, Key_reads, Key_write_requests, Key_writes, Last_query_cost, Max_used_connections, Not_flushed_delayed_rows, Open_files, Open_streams, Open_tables, Opened_tables, Prepared_stmt_count, Qcache_free_blocks, Qcache_free_memory, Qcache_hits, Qcache_inserts, Qcache_lowmem_prunes, Qcache_not_cached, Qcache_queries_in_cache, Qcache_total_blocks, Queries, Questions, Rpl_status, Select_full_join, Select_full_range_join, Select_range, Select_range_check, Select_scan, Slave_open_temp_tables, Slave_retried_transactions, Slave_running, Slow_launch:::16399502-EC32-11DF-A48C-B3CF5ABBF662:::
Nov 9 10:49:30 zmail100 zimbramon[9493]: 9493:info: :::16399502-EC32-11DF-A48C-B3CF5ABBF662:::_threads, Slow_queries, Sort_merge_passes, Sort_range, Sort_rows, Sort_scan, Ssl_accept_renegotiates, Ssl_accepts, Ssl_callback_cache_hits, Ssl_cipher, Ssl_cipher_list, Ssl_client_connects, Ssl_connect_renegotiates, Ssl_ctx_verify_depth, Ssl_ctx_verify_mode, Ssl_default_timeout, Ssl_finished_accepts, Ssl_finished_connects, Ssl_session_cache_hits, Ssl_session_cache_misses, Ssl_session_cache_mode, Ssl_session_cache_overflows, Ssl_session_cache_size, Ssl_session_cache_timeouts, Ssl_sessions_reused, Ssl_used_session_cache_entries, Ssl_verify_depth, Ssl_verify_mode, Ssl_version, Table_locks_immediate, Table_locks_waited, Tc_log_max_pages_used, Tc_log_page_size, Tc_log_page_waits, Threads_cached, Threads_connected, Threads_created, Threads_running, Uptime:: 11/09/2010 10:49:30,4,0,0,0,30346412,1:::16399AB6-EC32-11DF-A48C-B3CF5ABBF662:::
Nov 9 10:49:30 zmail100 zimbramon[9493]: :::16399AB6-EC32-11DF-A48C-B3CF5ABBF662:::39997338,5,0,0,0,0,0,0,44,0,407,0,1 1785,1,0,0,4,0,0,6190,0,0,0,0,0,5,0,0,0,0,0,0,0,0, 22662,0,0,0,0,0,0,0,0,0,0,0,0,0,16,0,0,0,0,0,10200 3,0,86924,306036,0,0,0,8,0,0,0,1,0,0,0,5801,0,0,0, 0,0,0,0,0,0,0,18427,0,48,0,8,0,0,0,0,0,0,0,0,0,0,0 ,6867,420,0,0,0,0,0,0,OFF,18437,892,5,13156,0,0,0, 1,25163,0,0,0,528,7759979,7418186,17117,6449,28998 67,117,0,0,0,2909584,22282,0,41848,285205,801,3082 88,6,117,26185947,15796,0,91287,42523,0,0,0,367153 152,16528,58296,1381479424,41848,7525,0,7302,7147, 13372,0,0,7016960,16384,18,22276,41848,0,0,0,0,0,2 805,313,16881815,7081,0,6694,1119,318481,0,24580,2 4580,0.000000,4,0,75,0,417,428,0,0,0,0,0,0,0,0,0,5 79273,579273,NULL,0,0,2979,0,12185,0,0,OFF,0,514,0 ,5860,4682,637,0,0,0,,,0,0,0,0,0,0,0,0,0,NONE,0,0, 0,0,0,0,0,,117604,0,0,0,0,2,2,4,1,348488
Nov 9 10:49:43 zmail100 zimbramon[9478]: 9478:info: zmstat io.csv: timestamp, sda:tps, sda:kB_read/s, sda:kB_wrtn/s, sda:kB_read, sda:kB_wrtn:: 11/09/2010 10:49:43, 4.07, 0.00, 44.50, 0, 1335
Nov 9 10:49:44 zmail100 zimbramon[9467]: 9467:info: zmstat io-x.csv: timestamp, sda:rrqm/s, sda:wrqm/s, sda:r/s, sda:w/s, sda:rkB/s, sda:wkB/s, sda:avgrq-sz, sda:avgqu-sz, sda:await, sda:svctm, sda:%util:: 11/09/2010 10:49:44, 0.00, 4.47, 0.00, 4.07, 0.00, 44.52, 21.89, 0.15, 37.77, 8.25, 3.35
Nov 9 10:49:44 zmail100 zimbramon[9510]: 9510:info: zmstat convertd.csv: timestamp, utime, stime, cputime, rchar, wchar, read_bytes, write_bytes, rss, processes, threads:: 11/09/2010 10:49:44, 0, 0, 0, 0, 0, 0, 0, 10172, 6, 6
Nov 9 10:49:46 zmail100 zimbramon[9465]: 9465:info: zmstat vm.csv: timestamp, r, b, swpd, free, buff, cache, si, so, bi, bo, in, cs, us, sy, id, wa, st, MemTotal, MemFree, Buffers, Cached, SwapCached, Active, Inactive, HighTotal, HighFree, LowTotal, LowFree, SwapTotal, SwapFree, Dirty, Writeback, AnonPages, Mapped, Slab, PageTables, NFS_Unstable, Bounce, CommitLimit, Committed_AS, VmallocTotal, VmallocUsed, VmallocChunk, HugePages_Total, HugePages_Free, HugePages_Rsvd, Hugepagesize, loadavg:: 11/09/2010 10:49:46, 3, 0, 4, 359388, 146368, 10409600, 0, 0, 0, 39, 1222, 788, 29, 3, 67, 0, 0, 16444328, 359140, 146368, 10409600, 4, 9309084, 6118568, 0, 0, 16444328, 359140, 15999252, 15999248, 1360, 0, 4871708, 52468, 558424, 23496, 0, 0, 24221416, 15020972, 34359738367, 50948, 34359687415, 0, 0, 0, 2048, 0.72

6. zmsoap -z GetLoggerStatsRequest stats/@name=zmmtastats | head -20

zmsoap -z GetLoggerStatsRequest stats/@name=zmmtastats | head -20







7. zmsoap -z GetLoggerStatsRequest stats/@name=zmmtastats @limit=1 | head -50

zmsoap -z GetLoggerStatsRequest stats/@name=zmmtastats @limit=1 | head -50

[Biohazard]

Just enable de "crond" service ! i'm using zimbra zcs 7 over centos 5.4