admin account getting "spammed" by unexpected notification messages

[thomasf]

Dear Zimbra community,

I'm totally new in this zimbra world and I managed to install a version 6 of Zilmbra network for evaluation purpose in our organization.

Installation went well but as soon as I started the service I noticed a heavy workload on a server, resulting to very bad performance of the system (webmail access, administration console etc.)

After having searched, I found out that the admin@mail.exmaple.com mailbox was receiving several messages by minute with the following text

Jan 6 12:15:45 mailtest zimbramon[2163]: 2163:err: Service status change: mailtest.drctmb.com stats changed from running to stopped

The time is not always the same but always around 12:15 Jan 6 (althought I'm posting this message on Jan 7)

I suspect that this is the cause of my server being so slow but I'm not 100% sure.

I'm using Release 6.0.4_GA_2038.UBUNTU8_64 UBUNTU8_64 NETWORK edition.

The folder /opt/zimbra/data/postfix/spool/maildrop is getting more and more files every minutes.

It takes ages to start and stop the zimbra services.

I've seen in the forum someone reporting the same kind of problems but it was with a previous version of Zimbra, I thought this bug was corrected in my version.

Any help will be really welcome

Thanks

Thomas

[thomasf]

Hello,

No one replied, I guess it is because of the lack of information.

Well, when I started the system the next day the problem seemed to be gone by itself and I was able to delete the 45000 messages left in admin mailbox.

But today, the same problem came again.

In the meantime I had the chance to look further into Zimbra documentation and now here is what I get from the log file.

11 17:47:07 mailtest zmmailboxdmgr[5370]: assuming no other instance is running
Jan 11 17:47:07 mailtest zmmailboxdmgr[11246]: start requested
Jan 11 17:47:07 mailtest zmmailboxdmgr[5370]: no manager process is running
Jan 11 17:47:07 mailtest zmmailboxdmgr[14574]: status requested
Jan 11 17:47:07 mailtest zmmailboxdmgr[14574]: status OK
Jan 11 17:47:07 mailtest zmmailboxdmgr[11246]: checking if another instance of manager is already running
Jan 11 17:47:07 mailtest zmmailboxdmgr[14644]: status requested
Jan 11 17:47:07 mailtest zmmailboxdmgr[14644]: status OK
Jan 11 17:47:07 mailtest zmmailboxdmgr[11246]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:07 mailtest zmmailboxdmgr[11246]: assuming no other instance is running
Jan 11 17:47:07 mailtest zmmailboxdmgr[11246]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:07 mailtest zmmailboxdmgr[11246]: assuming no other instance is running
Jan 11 17:47:07 mailtest zmmailboxdmgr[11247]: wrote manager pid 11247 to /opt/zimbra/log/zmmailboxd_manager.pid
Jan 11 17:47:07 mailtest zmmailboxdmgr[11248]: wrote java pid 11248 to /opt/zimbra/log/zmmailboxd_java.pid
Jan 11 17:47:07 mailtest zmmailboxdmgr[11247]: manager started mailboxd/JVM with pid 11248
Jan 11 17:47:07 mailtest zmmailboxdmgr[11643]: status requested
Jan 11 17:47:07 mailtest zmmailboxdmgr[11643]: status OK
Jan 11 17:47:07 mailtest zmmailboxdmgr[5370]: status requested
Jan 11 17:47:07 mailtest zmmailboxdmgr[5370]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: status requested
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: no manager process is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[11246]: start requested
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: no manager process is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[14574]: status requested
Jan 11 17:47:08 mailtest zmmailboxdmgr[14574]: status OK
Jan 11 17:47:08 mailtest zmmailboxdmgr[11246]: checking if another instance of manager is already running
Jan 11 17:47:08 mailtest zmmailboxdmgr[14644]: status requested
Jan 11 17:47:08 mailtest zmmailboxdmgr[14644]: status OK
Jan 11 17:47:08 mailtest zmmailboxdmgr[11246]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11246]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[11246]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11246]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[11247]: wrote manager pid 11247 to /opt/zimbra/log/zmmailboxd_manager.pid
Jan 11 17:47:08 mailtest zmmailboxdmgr[11248]: wrote java pid 11248 to /opt/zimbra/log/zmmailboxd_java.pid
Jan 11 17:47:08 mailtest zmmailboxdmgr[11247]: manager started mailboxd/JVM with pid 11248
Jan 11 17:47:08 mailtest zmmailboxdmgr[11643]: status requested
Jan 11 17:47:08 mailtest zmmailboxdmgr[11643]: status OK
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: status requested
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: status requested
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[5370]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: assuming no other instance is running
Jan 11 17:47:08 mailtest zmmailboxdmgr[11239]: no manager process is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[5370]: assuming no other instance is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[11246]: start requested
Jan 11 17:47:09 mailtest zmmailboxdmgr[5370]: no manager process is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[14574]: status requested
Jan 11 17:47:09 mailtest zmmailboxdmgr[14574]: status OK
Jan 11 17:47:09 mailtest zmmailboxdmgr[11246]: checking if another instance of manager is already running
Jan 11 17:47:09 mailtest zmmailboxdmgr[14644]: status requested
Jan 11 17:47:09 mailtest zmmailboxdmgr[14644]: status OK
Jan 11 17:47:09 mailtest zmmailboxdmgr[11246]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:09 mailtest zmmailboxdmgr[11246]: assuming no other instance is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[11246]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:09 mailtest zmmailboxdmgr[11246]: assuming no other instance is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[11247]: wrote manager pid 11247 to /opt/zimbra/log/zmmailboxd_manager.pid
Jan 11 17:47:09 mailtest zmmailboxdmgr[11248]: wrote java pid 11248 to /opt/zimbra/log/zmmailboxd_java.pid
Jan 11 17:47:09 mailtest zmmailboxdmgr[11247]: manager started mailboxd/JVM with pid 11248
Jan 11 17:47:09 mailtest zmmailboxdmgr[11643]: status requested
Jan 11 17:47:09 mailtest zmmailboxdmgr[11643]: status OK
Jan 11 17:47:09 mailtest zmmailboxdmgr[5370]: status requested
Jan 11 17:47:09 mailtest zmmailboxdmgr[5370]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:09 mailtest zmmailboxdmgr[5370]: assuming no other instance is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[11239]: status requested
Jan 11 17:47:09 mailtest zmmailboxdmgr[11239]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 11 17:47:09 mailtest zmmailboxdmgr[11239]: assuming no other instance is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[5370]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:09 mailtest zmmailboxdmgr[11239]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 11 17:47:09 mailtest zmmailboxdmgr[11239]: assuming no other instance is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[11239]: no manager process is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[5370]: assuming no other instance is running
Jan 11 17:47:09 mailtest zmmailboxdmgr[11246]: start requested

And this is repeating again and again.

It looks like the system is stopping and restarting the mailboxd server several times per second because he cannot find the .pid files.
But the files are actually there.

Any suggestion or idea ? I admit I feel quite lost and would really appreciate help.

Thanks

[vbn]

Could be a permission issue on the directory... try command zmfixperms from /opt/zimbra/libexec and then try this :

su - zimbra
zmcontrol stop
ps -ef |grep zimbra (to check lingering processes)
zmcontrol start

...see if you still get the messages in logs. I have never had this issue. How did you install ? By the docs ?

[thomasf]

Hello and thank you very much for the reply.
Unfortunately it didn't work

Here is the sequence of commands as requested

root@mailtest:~# /opt/zimbra/libexec/zmfixperms
root@mailtest:~# su - zimbra
zimbra@mailtest:~$ zmcontrol stop
Host mailtest.drctmb.com
        Stopping stats...Done.
        Stopping mta...Done.
        Stopping spell...Done.
        Stopping snmp...Done.
        Stopping archiving...Done.
        Stopping antivirus...Done.
        Stopping antispam...Done.
        Stopping imapproxy...Done.
        Stopping memcached...Done.
        Stopping mailbox...Done.
        Stopping convertd...Done.
        Stopping logger...Done.
        Stopping ldap...Done.
zimbra@mailtest:~$ ps -ef |grep zimbra
zimbra   28041 16820  0 09:47 pts/0    00:00:00 su - zimbra
zimbra   28042 28041  0 09:47 pts/0    00:00:00 -su
zimbra   29888 28042  0 09:53 pts/0    00:00:00 ps -ef
zimbra   29889 28042  0 09:53 pts/0    00:00:00 grep zimbra
zimbra@mailtest:~$ zmcontrol start
Host mailtest.drctmb.com
        Starting ldap...Done.
        Starting logger...Done.
        Starting convertd...Done.
        Starting mailbox...Done.
        Starting antispam...Done.
        Starting antivirus...Done.
        Starting snmp...Done.
        Starting spell...Done.
        Starting mta...Done.
        Starting stats...Done.
zimbra@mailtest:~$ tail -100 /var/log/zimbra.log | grep mailboxdmgr
Jan 12 10:07:05 mailtest zmmailboxdmgr[11001]: status requested
Jan 12 10:07:05 mailtest zmmailboxdmgr[11001]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 12 10:07:05 mailtest zmmailboxdmgr[5950]: assuming no other instance is running
Jan 12 10:07:05 mailtest zmmailboxdmgr[11001]: assuming no other instance is running
Jan 12 10:07:05 mailtest zmmailboxdmgr[11001]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 12 10:07:05 mailtest zmmailboxdmgr[11001]: assuming no other instance is running
Jan 12 10:07:05 mailtest zmmailboxdmgr[11001]: no manager process is running
Jan 12 10:07:05 mailtest zmmailboxdmgr[5950]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 12 10:07:05 mailtest zmmailboxdmgr[11008]: start requested
Jan 12 10:07:05 mailtest zmmailboxdmgr[11008]: checking if another instance of manager is already running
Jan 12 10:07:05 mailtest zmmailboxdmgr[5950]: assuming no other instance is running
Jan 12 10:07:05 mailtest zmmailboxdmgr[11008]: file /opt/zimbra/log/zmmailboxd_manager.pid does not exist
Jan 12 10:07:05 mailtest zmmailboxdmgr[11008]: assuming no other instance is running
Jan 12 10:07:05 mailtest zmmailboxdmgr[11008]: file /opt/zimbra/log/zmmailboxd.pid does not exist
Jan 12 10:07:05 mailtest zmmailboxdmgr[11008]: assuming no other instance is running

I have also noted that the files zmmailboxd_java.pid and zmmailboxd_manager.pid are owned by root and not by zimbra. Is this normal ?

zimbra@mailtest:~$ ls -l /opt/zimbra/log/*.pid
-rw-r----- 1 zimbra zimbra 5 Jan 12 09:56 /opt/zimbra/log/amavisd.pid
-rw-rw-r-- 1 zimbra zimbra 4 Jan 12 09:56 /opt/zimbra/log/clamd.pid
-rw-r----- 1 zimbra zimbra 6 Jan 12 09:55 /opt/zimbra/log/convertd.pid
-rw-rw---- 1 zimbra zimbra 4 Jan 12 09:56 /opt/zimbra/log/freshclam.pid
-rw-r----- 1 zimbra zimbra 5 Jan 12 09:56 /opt/zimbra/log/httpd.pid
-rw-r----- 1 zimbra zimbra 6 Jan 12 09:55 /opt/zimbra/log/logswatch.pid
-rw-r----- 1 zimbra zimbra 5 Jan 12 09:56 /opt/zimbra/log/swatch.pid
-rw-r--r-- 1 root   root   5 Jan 12 09:56 /opt/zimbra/log/zmmailboxd_java.pid
-rw-r--r-- 1 root   root   5 Jan 12 09:56 /opt/zimbra/log/zmmailboxd_manager.pid
-rw-r----- 1 zimbra zimbra 4 Jan 12 09:55 /opt/zimbra/log/zmmtaconfig.pid
-rw-r----- 1 zimbra zimbra 6 Jan 12 09:55 /opt/zimbra/log/zmrrdfetch-server.pid

Finally, it seems that one .pid file is missing : zmmailboxd.pid, but the 2 other zmmailboxd_* files are there.

Jan 12 10:07:05 mailtest zmmailboxdmgr[11008]: file /opt/zimbra/log/zmmailboxd.pid does not exist

I did a classic install using the scripts install.sh

I had done a first attemps to install which had failed due to some DNS problems.
I removed everything following the uninstallation instructions provided on the wiki and then reinstalled from scratch and didn't get any error.

Big thanks in advance for any help.

Otherwise I will probably need to start over installation again ...

Thomas

[vbn]

Well.. my log directory looks just like yours

Yes those two are root in mine also. Dont have those error messages in my log.

[thomasf]

Finally I decided to re-install the whole system (including the OS) and this time everything looks fine. I don't have the odd log messages anymore and the server looks much faster.

It will probably remain a mystery.

Thanks anyway for the help

Thomas