STATS service stopped and cannot run

[Labsy]

After upgrading to latest ZCS I am not sure if this is related, but might be - STATS service cannot be run anymore.
I upgraded from
Release 6.0.3_GA_1915.UBUNTU8_64 UBUNTU8_64 FOSS edition.
to
Release 6.0.6_GA_2324.UBUNTU8_64 UBUNTU8_64 FOSS edition.

I also ENABLED few Zimlets:
- com_maki_exclusivetag
- com_zimbra_dnd
- com_zimbra_dndext
- com_zimbra_email2doc
- com_zimbra_gtranslator
- com_zimbra_holidaycalendars
- com_zimbra_ local

I do not know when problems with STATS started, or when I upgraded, or after I installed these Zimlets, but my STATS does not want to start anmyore. Here is zmstat.out log:

less /opt/zimbra/zmstat/zmstat.out
apache-convertd not running, not launching zmstat-convertd
/opt/zimbra/zmstat/cpu.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/cpu.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/cpu.csv to /opt/zimbra/zmstat//2010-06-29/cpu.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/vm.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/vm.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/vm.csv to /opt/zimbra/zmstat//2010-06-29/vm.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/io-x.csv was stale (2010-06-29) pre-rotating
/opt/zimbra/zmstat/io.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/io.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/io.csv to /opt/zimbra/zmstat//2010-06-29/io.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
sh: cannot create /opt/zimbra/zmstat//2010-06-29/io-x.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/io-x.csv to /opt/zimbra/zmstat//2010-06-29/io-x.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/mtaqueue.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/mtaqueue.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/mtaqueue.csv to /opt/zimbra/zmstat//2010-06-29/mtaqueue.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/df.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/df.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/df.csv to /opt/zimbra/zmstat//2010-06-29/df.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/allprocs.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/allprocs.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/allprocs.csv to /opt/zimbra/zmstat//2010-06-29/allprocs.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
/opt/zimbra/zmstat/mysql.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/mysql.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/mysql.csv to /opt/zimbra/zmstat//2010-06-29/mysql.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
Warning: Not possible to monitor process stats
/opt/zimbra/zmstat/proc.csv was stale (2010-06-29) pre-rotating
sh: cannot create /opt/zimbra/zmstat//2010-06-29/proc.csv.gz: Permission denied
Unable to move /opt/zimbra/zmstat/proc.csv to /opt/zimbra/zmstat//2010-06-29/proc.csv.gz at /opt/zimbra/zimbramon/lib/Zimbra/Mon/Zmstat.pm line 256.
~

Permission denied?
Any idea?

[Hivos]

Interesting, same issue here ever since our upgrade to 6.0.6. I noticed the ownership on the "date" directories in /opt/zimbra/zmstat has changed from zimbra:zimbra to root:root, which seems to cause the problem. This happened after our upgrade on May 27.

drwxr-x--- 2 zimbra zimbra 4.0K 2010-05-24 00:13 2010-05-23
drwxr-x--- 2 zimbra zimbra 4.0K 2010-05-25 00:11 2010-05-24
drwxr-x--- 2 zimbra zimbra 4.0K 2010-05-26 00:10 2010-05-25
drwxr-x--- 2 zimbra zimbra 4.0K 2010-05-27 00:08 2010-05-26
drwxr-xr-x 2 root root 4.0K 2010-05-28 00:00 2010-05-27
drwxr-xr-x 2 root root 4.0K 2010-05-29 00:00 2010-05-28
drwxr-xr-x 2 root root 4.0K 2010-05-30 00:00 2010-05-29
drwxr-xr-x 2 root root 4.0K 2010-05-31 00:00 2010-05-30

Changing the ownership of these folders to zimbra:zimbra does seem to fix the issue, but only until the next day of course.

[Labsy]

Hivos, is there anything interesting in your server's log file /opt/zimbra/zmstat/zmstat.out?

[Hivos]

A bit strange, but the ownership issue seems to have been solved. New "date" folders are automatically owned by zimbra:zimbra now. The server status however is still not displayed, or at least no longer than a day after a restart of zimbra.

zmstat.out:

Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.
Use of uninitialized value in subtraction (-) at /opt/zimbra/libexec/zmstat-allprocs line 118.

Will look into this further.

[profediego]

Hi, i am having the same issue, but i know it start just after i did a

sudo swapoff -a
sudo swapon -a

hope this helps for something.

regards

[Labsy]

Any official response on this yet?
STATS service still down until latest upgrade.

EDIT: Sorry, Bugfix #45010 "The correct permissions on the stats folders rotate function are now set" in latest 6.0.7 GA update should have fixed this issue. I've just overlooked new update.

[v_augusto]

I have the Ubunto 10.04 LTS 64, Zimbra 6.0.10 and STATS was stoped and I did what profediego said and... !it works..!
thank you

# sudo swapoff -a
# sudo swapon -a

Zimbra
$ zmcontrol stop
$ zmcontrol stat