Stats don't update

[Doug_M]

Hi,

I installed Zimbra on OpenSuse 10 and things went great. I'm up and running with only two problems. One is about times and I've started a thread here.

The other is stats not updating. I've read other stats posts but can't find anything that has helped me yet. My stats haven't updated beyond the first 48 hours. The system has been running for over a week.

- logswatch is running
- running zmgengraphs added a quota graph but did not update the others (seemingly at any rate)
- there are logging and zmgengraphs entries in crontab
- there are no errors in /var/log/zimbra.log

I don't know where to go from here.

Regards,
Doug

[scottnelson]

do an:
su - zimbra
then:
zmcontrol stop

Then do a

ps -ef | grep tail

do you see any processes still running owned by zimbra?

I have to stop my server everyday and kill those processes and start zimbra.

Maybe you are having same issue?

Scotty

[Doug_M]

Ok, I did that, had to kill the tail processes too. Are you saying that my stats will update for a 24 period after that? Have you submitted a bug report?

Thanks,
Doug

[scottnelson]

I think it's this one:
http://bugzilla.zimbra.com/show_bug.cgi?id=6616

I have to stop and restart everyday or yes, the stats don't update as the tail process get stuck feeding a dead process until killed so, your stats and daily e-mail log go missing until then.

At least, that what happens to me.

Scotty

[Doug_M]

Scotty,

I just upgraded to 3.2 Beta 2. I'll watch and see if that version has the same bug.

[Doug_M]

Still have the problem with 3.2 Beta2. Reading the bug report I see it says to use Perl's File::Tail so I've installed that and restarted Zimbra. We'll see what happens over the next 24 hours.

[layer3guru]

Doug thank you so much please let us know how this turns out. Because my stats are not updating and my nightly reports are blank. But I did notice and reported here that after a stop and start it would run for 24 hours then seem to break at least now I know why.

[Doug_M]

No luck with Perl module File::Tail. Maybe simply installing it isn't enough?

Here's the output of zmlogprocess (I've edited out a few dozen lines for this post):

zimbra@zimbra:~/libexec> ./zmlogprocess
zimbra maps to zimbra.mccomber.ca
zimbra maps to zimbra.mccomber.ca
zimbra maps to zimbra.mccomber.ca
zimbra maps to zimbra.mccomber.ca
zimbra maps to zimbra.mccomber.ca
zimbra maps to zimbra.mccomber.ca
zimbra maps to zimbra.mccomber.ca
zimbra maps to zimbra.mccomber.ca
Processing mta entries from 5760
Found 1 messages
Inserted 1 rows
Saving ID 5760
Deleting processed postfix logs from raw_logs...Done
Processing clamd entries from 5757
Found 0 entries
Deleting processed clamd logs from raw_logs...Done
Processing amavis entries from 5758
Found 0 entries
Deleting processed amavis logs from raw_logs...Done
Processing sendmail entries from 0
Found 0 entries
Deleting processed sendmail logs from raw_logs...Done
Processing zimbramon entries from 5796
Found 0 entries
Deleting processed zimbramon logs from raw_logs...Done
Aggregating hour mta from 2006-08-07 01:00:00 to 2006-08-07 02:00:00
Aggregating hour mta from 2006-08-07 02:00:00 to 2006-08-07 03:00:00
Aggregating hour mta from 2006-08-07 03:00:00 to 2006-08-07 04:00:00
.
.
.
Aggregating day mta from 2006-08-07 00:00:00 to 2006-08-08 00:00:00
Aggregating hour amavis from 2006-08-07 01:00:00 to 2006-08-07 02:00:00
Aggregating hour amavis from 2006-08-07 02:00:00 to 2006-08-07 03:00:00
Aggregating hour amavis from 2006-08-07 03:00:00 to 2006-08-07 04:00:00
.
.
.
Aggregating day amavis from 2006-08-07 00:00:00 to 2006-08-08 00:00:00
Aggregating hour disk from 2006-08-07 02:00:00 to 2006-08-07 03:00:00
Aggregating hour disk from 2006-08-07 03:00:00 to 2006-08-07 04:00:00
Aggregating hour disk from 2006-08-07 04:00:00 to 2006-08-07 05:00:00
.
.
.
Aggregating day disk from 2006-08-07 00:00:00 to 2006-08-08 00:00:00
RAW: 31
SUM: 730
Pruning raw mta logs from 2006-07-08 00:00:00
Pruning raw amavis logs from 2006-07-08 00:00:00
Pruning raw disk logs from 2006-07-08 00:00:00
Pruning summary mta logs from 2004-08-08 00:00:00
Pruning summary amavis logs from 2004-08-08 00:00:00
Pruning summary disk logs from 2004-08-08 00:00:00
Pruning other raw logs from 2006-07-08 00:00:00

And here is the output from zmgengraphs:

zimbra@zimbra:~/libexec> perl zmgengraphs
Generating hour graph for mta on zimbra.mccomber.ca
Generating hour graph for mta on zimbra.mccomber.ca
Generating day graph for mta on zimbra.mccomber.ca
Generating day graph for mta on zimbra.mccomber.ca
Generating month graph for mta on zimbra.mccomber.ca
Generating month graph for mta on zimbra.mccomber.ca
Generating year graph for mta on zimbra.mccomber.ca
Generating year graph for mta on zimbra.mccomber.ca
Generating hour graph for mta on ALL
Generating hour graph for mta on ALL
Generating day graph for mta on ALL
Generating day graph for mta on ALL
Generating month graph for mta on ALL
Generating month graph for mta on ALL
Generating year graph for mta on ALL
Generating year graph for mta on ALL
Generating hour graph for amavis on zimbra.mccomber.ca
Generating day graph for amavis on zimbra.mccomber.ca
Generating month graph for amavis on zimbra.mccomber.ca
Generating year graph for amavis on zimbra.mccomber.ca
Generating hour graph for amavis on ALL
Generating day graph for amavis on ALL
Generating month graph for amavis on ALL
Generating year graph for amavis on ALL
Generating hour graph for disk on zimbra.mccomber.ca
Generating hour graph for disk on zimbra.mccomber.ca
Generating day graph for disk on zimbra.mccomber.ca
Generating day graph for disk on zimbra.mccomber.ca
Generating month graph for disk on zimbra.mccomber.ca
Generating month graph for disk on zimbra.mccomber.ca
Generating year graph for disk on zimbra.mccomber.ca
Generating year graph for disk on zimbra.mccomber.ca

After running those two commands when I log into the Admin web client and check that stats there is no change!

Regards,
Doug

[layer3guru]

Has anyone had any luck with this at all. Scott I would like to know exactly what you are doing because I zmcontrol stop and start and killl the tail and I still get blank reports.

[dijichi2]

Still have the problem with 3.2 Beta2. Reading the bug report I see it says to use Perl's File::Tail so I've installed that and restarted Zimbra. We'll see what happens over the next 24 hours.

this isn't likely to do any good - zimbra uses its own perl libs and libpaths and needed to alter its own code to take advantage of native tail, which the bug report indicates it has done.

i've often had to kill tail processes off manually when upgraded or restarting etc. i see now running 4.0_rc1 that these no longer are present, and that my nightly stat reports are actually working now and not just the blank email i'm used to! if you do ps -ef |grep tail, you should not see any tail processes running, if you have then maybe you need to upgrade?

having said that the stats in the admin interface is still borked for me, the services status is working correctly but my graphs are mostly blank and haven't been updated for a month or so, despite all my best prodding...