logger not functioning propperly

[rwagter]

Hi all,

my stats and daily reports arent coming thru. After extensive search on the forum I have not found a solution. What I tried sofar:

query logmysql tables:
raw_logs en service status are filled with records the rest of the tables are emptry
there are no errors in the database

checked al steps described in:
Brian-Notes - Zimbra :: Wiki

no errors
I removed te database completely and reinitialized them using zmloggerinit

cron jobs are there, services are running. No errors in zimbra.log

It just seems that zmloggerproccess is not picking up the messages in the raw_logs table and disects them into the other log tables.

Anyone.

[rwagter]

Some more research:

last entries in zmstat:

[root@mail zmstat]# tail -20 zmstat.out
apache-convertd not running, not launching zmstat-convertd
Warning: Not possible to monitor process stats
apache-convertd not running, not launching zmstat-convertd
Warning: Not possible to monitor process stats
apache-convertd not running, not launching zmstat-convertd
Warning: Not possible to monitor process stats
apache-convertd not running, not launching zmstat-convertd
zmstat-fd.pid: Already running as pid 6636
/opt/zimbra/zmstat/mtaqueue.csv was stale (2008-11-11) pre-rotating
Warning: Not possible to monitor process stats
apache-convertd not running, not launching zmstat-convertd
Warning: Not possible to monitor process stats
apache-convertd not running, not launching zmstat-convertd
Warning: Not possible to monitor process stats
apache-convertd not running, not launching zmstat-convertd
Warning: Not possible to monitor process stats
11/12/2008 22:09:01: ERROR: No such process: '26438'
11/13/2008 22:22:30: ERROR: No such process: '839'
apache-convertd not running, not launching zmstat-convertd
Warning: Not possible to monitor process stats

When checking logfiles I'm missing the following files:
convertd.log
zmconvertd.log
zimbrastats.csv

/tmp/zmlogger.out is missing too.

This is the output from a ls -ll /opt/zimbra/logger/db/data/zimbra_logger

-rw-rw---- 1 zimbra zimbra      0 Nov 12 11:19 amavis.MYD
-rw-rw---- 1 zimbra zimbra   1024 Nov 14 14:56 amavis.MYI
-rw-rw---- 1 zimbra zimbra   8978 Nov 12 11:19 amavis.frm
-rw-rw---- 1 zimbra zimbra      0 Nov 12 11:19 amavis_aggregate.MYD
-rw-rw---- 1 zimbra zimbra   1024 Nov 14 14:56 amavis_aggregate.MYI
-rw-rw---- 1 zimbra zimbra   8830 Nov 12 11:19 amavis_aggregate.frm
-rw-rw---- 1 zimbra zimbra     44 Nov 12 11:19 config.MYD
-rw-rw---- 1 zimbra zimbra   5120 Nov 14 14:56 config.MYI
-rw-rw---- 1 zimbra zimbra   8674 Nov 12 11:19 config.frm
-rw-rw---- 1 zimbra zimbra     61 Nov 12 11:19 db.opt
-rw-rw---- 1 zimbra zimbra      0 Nov 12 11:19 disk_aggregate.MYD
-rw-rw---- 1 zimbra zimbra   1024 Nov 14 14:57 disk_aggregate.MYI
-rw-rw---- 1 zimbra zimbra   8810 Nov 12 11:19 disk_aggregate.frm
-rw-rw---- 1 zimbra zimbra      0 Nov 12 11:19 disk_status.MYD
-rw-rw---- 1 zimbra zimbra   1024 Nov 12 11:19 disk_status.MYI
-rw-rw---- 1 zimbra zimbra   8744 Nov 12 11:19 disk_status.frm
-rw-rw---- 1 zimbra zimbra      0 Nov 12 11:19 mta.MYD
-rw-rw---- 1 zimbra zimbra   1024 Nov 14 14:57 mta.MYI
-rw-rw---- 1 zimbra zimbra  13168 Nov 12 11:19 mta.frm
-rw-rw---- 1 zimbra zimbra      0 Nov 12 11:19 mta_aggregate.MYD
-rw-rw---- 1 zimbra zimbra   1024 Nov 14 14:57 mta_aggregate.MYI
-rw-rw---- 1 zimbra zimbra   8784 Nov 12 11:19 mta_aggregate.frm
-rw-rw---- 1 zimbra zimbra      0 Nov 12 11:19 processing_history.MYD
-rw-rw---- 1 zimbra zimbra   1024 Nov 14 14:57 processing_history.MYI
-rw-rw---- 1 zimbra zimbra   8584 Nov 12 11:19 processing_history.frm
-rw-rw---- 1 zimbra zimbra 539252 Nov 14 15:40 raw_logs.MYD
-rw-rw---- 1 zimbra zimbra 147456 Nov 14 15:40 raw_logs.MYI
-rw-rw---- 1 zimbra zimbra   8758 Nov 12 11:19 raw_logs.frm
-rw-rw---- 1 zimbra zimbra    712 Nov 14 15:42 service_status.MYD
-rw-rw---- 1 zimbra zimbra   4096 Nov 14 15:42 service_status.MYI
-rw-rw---- 1 zimbra zimbra   8708 Nov 12 11:19 service_status.frm

Rechecked the status of all tables and they are without errors.

A zmcontrol tells me all services are running.

iostat is installed as is syslogkd.

Everything else is working normal, this is the only anying part which is not functioning

--ralph--

[phoenix]

The use of convertd is only for the Network Edition version Zimbra, it's used for attachment conversion. According to your signature you have the Open Source version, why do you think the missing logs would be on your system?

[rwagter]

I merely checked all available log files to see if there's a clue why de stats and reports don't wordt. I was onder the impression that only:
convertd.log
was used in NE. Disregarding the logs that aren't supposed to be there it doesn't change the problem that the daily report was again without messages and the the raw_logs table is filling up quit nicely