tomcat not running / postfix/postqueue errors

[seravitae]

Hi there, zimbra works fine - only if i reinstall/upgrade it every bootup.

I have to sudo killall slapd (for some reason) and let zmcontrol start bring it up otherwise it errors, every bootup. THat was a couple of days ago - now when i boot up something refuses to come up at all!

zimbra@localhost:~$ zmcontrol start
Host localhost
Starting ldap...Done.
Starting logger...Done.
Starting mailbox...Done.
Starting imapproxy...Done.
Starting antispam...Done.
Starting antivirus...Done.
Starting snmp...Done.
Starting spell...Done.
Starting mta...Done.
zimbra@localhost:~$

(all good and well, except..)

zimbra@localhost:~$ zmcontrol status
Host localhost
antispam Running
antivirus Running
imapproxy Running
ldap Running
logger Running
mailbox Stopped
tomcat is not running
mta Running
snmp Running
spell Running
zimbra@localhost:~$

Right, so zimbra lied to me before mailbox obviously didn't come up. (this seems like a bug? not reporting correctly?)

Okay, so lets investigate tomcat.

zimbra@localhost:~$ /opt/zimbra/bin/tomcat status
zimbra@localhost:~$
(does not report anything?)

zimbra@localhost:~$ ps aux | grep tomcat
root 7646 0.0 0.1 1588 360 ? Ss 11:44 0:00 /opt/zimbra/libexec/zmtomcatmgr start -Xms54m -Xmx54m -client -XX:NewRatio=2 -Djava.awt.headless=true
root 7671 55.2 14.7 231064 27596 ? Rl 11:45 0:02 /opt/zimbra/jdk1.5.0_08/bin/java -Xms54m -Xmx54m -client -XX:NewRatio=2 -Djava.awt.headless=true -Dcatalina.base=/opt/zimbra/apache-tomcat-5.5.15 -Dcatalina.home=/opt/zimbra/apache-tomcat-5.5.15 -Djava.io.tmpdir=/opt/zimbra/apache-tomcat-5.5.15/temp -Djava.library.path=/opt/zimbra/lib -Djava.endorsed.dirs=/opt/zimbra/apache-tomcat-5.5.15/common/endorsed -classpath /opt/zimbra/apache-tomcat-5.5.15/bin/bootstrap.jar:/opt/zimbra/apache-tomcat-5.5.15/bin/commons-logging-api.jar:/opt/zimbra/lib/jars/zimbra-launcher.jar com.zimbra.cs.launcher.TomcatLauncher
zimbra 7682 0.0 0.2 1668 532 pts/0 R+ 11:45 0:00 grep tomcat
zimbra@localhost:~$ /opt/zimbra/bin/tomcat status
zimbra@localhost:~$

(still not telling me anything...)

my mail.err log file says this:

(... lots more of these)
Mar 11 11:12:13 localhost zmtomcatmgr[2727]: no manager process is running
Mar 11 11:14:16 localhost zmtomcatmgr[2958]: no manager process is running
Mar 11 11:16:13 localhost zmtomcatmgr[3214]: no manager process is running
Mar 11 11:18:18 localhost zmtomcatmgr[3494]: no manager process is running
Mar 11 11:20:24 localhost zmtomcatmgr[3817]: no manager process is running
Mar 11 11:22:13 localhost zmtomcatmgr[4110]: no manager process is running
Mar 11 11:24:21 localhost zmtomcatmgr[4373]: no manager process is running
Mar 11 11:26:14 localhost zmtomcatmgr[4603]: no manager process is running
Mar 11 11:28:17 localhost zmtomcatmgr[4874]: no manager process is running
Mar 11 11:30:27 localhost zmtomcatmgr[5206]: no manager process is running
Mar 11 11:32:26 localhost zmtomcatmgr[5604]: no manager process is running
Mar 11 11:32:27 localhost zmtomcatmgr[5631]: no manager process is running
Mar 11 11:32:28 localhost postfix/postqueue[5639]: fatal: Queue report unavailable - mail system is down
Mar 11 11:32:29 localhost zmtomcatmgr[5645]: no manager process is running
Mar 11 11:39:31 localhost zmtomcatmgr[6238]: no manager process is running
Mar 11 11:39:57 localhost postfix/postqueue[6366]: fatal: Queue report unavailable - mail system is down
Mar 11 11:40:07 localhost postfix/postqueue[6415]: fatal: Queue report unavailable - mail system is down
Mar 11 11:41:30 localhost zmtomcatmgr[6246]: tomcat/JVM exited twice in 49 seconds (tolerance=60)
Mar 11 11:41:38 localhost zmtomcatmgr[6836]: no manager process is running
Mar 11 11:41:40 localhost zmtomcatmgr[6897]: no manager process is running
Mar 11 11:42:14 localhost zmtomcatmgr[7055]: no manager process is running
Mar 11 11:43:21 localhost zmtomcatmgr[7181]: no manager process is running
Mar 11 11:43:45 localhost zmtomcatmgr[7240]: no manager process is running
Mar 11 11:43:47 localhost zmtomcatmgr[7249]: no manager process is running
Mar 11 11:44:27 localhost zmtomcatmgr[7526]: no manager process is running
Mar 11 11:44:45 localhost zmtomcatmgr[7638]: no manager process is running
Mar 11 11:45:26 localhost zmtomcatmgr[7646]: tomcat/JVM exited twice in 26 seconds (tolerance=60)
Mar 11 11:46:14 localhost zmtomcatmgr[7887]: no manager process is running
Mar 11 11:48:14 localhost zmtomcatmgr[8165]: no manager process is running
Mar 11 11:49:33 localhost zmtomcatmgr[8391]: no manager process is running
Mar 11 11:49:35 localhost zmtomcatmgr[8398]: no manager process is running
Mar 11 11:50:03 localhost postfix/postqueue[8467]: fatal: Queue report unavailable - mail system is down
Mar 11 11:51:48 localhost zmtomcatmgr[8943]: no manager process is running
Mar 11 11:52:25 localhost postfix/postqueue[9114]: fatal: Queue report unavailable - mail system is down
Mar 11 11:52:58 localhost zmtomcatmgr[8951]: tomcat/JVM exited twice in 47 seconds (tolerance=60)
Mar 11 11:53:08 localhost zmtomcatmgr[9325]: no manager process is running
Mar 11 11:54:16 localhost zmtomcatmgr[9525]: no manager process is running


It seems I have something wrong with postfix as *well* as tomcat? or perhaps tomcat won't function without postfix?

Either way, how can i fix this? I have no idea what to do, but i hope i have provided enough information for someone to work this out..

Thanks in advance!

[jholder]

How much RAM do you have on this server?

tail -200 /opt/zimbra/log/mailbox.log

Post that.

[seravitae]

The machine is an 833mhz celeron running ubuntu edgy with 192mb of ram. Zimbra (apart from having to kill slapd/reboot) had been running fine, and fast, for at least a week prior to this..)

------
2007-03-11 12:12:13,910 INFO [main] [] soap - Servlet SoapServlet starting up
2007-03-11 12:12:14,134 INFO [main] [] soap - Adding service AccountService to SoapServlet
2007-03-11 12:12:15,693 INFO [main] [] soap - Adding service MailService to SoapServlet
2007-03-11 12:12:17,360 INFO [main] [] soap - Adding service IMService to SoapServlet
2007-03-11 12:12:17,392 INFO [main] [] misc - version=4.5.2_GA_699.UBUNTU6 release=20070216174007 builddate=20070216-1740 buildhost=build-ubuntu
2007-03-11 12:12:17,415 INFO [main] [] misc - LANG environment is set to: C
2007-03-11 12:12:17,725 INFO [main] [] DbPool - Setting mysql connector property: maxActive=10
2007-03-11 12:12:21,378 WARN [main] [] misc - LC.get(debug_calendar_force_utc) was null, returning empty string
2007-03-11 12:12:21,378 WARN [main] [] misc - LC.get(debug_validate_outgoing_icalendar) was null, returning empty string
2007-03-11 12:12:21,378 WARN [main] [] misc - LC.get(debug_disable_conversation) was null, returning empty string
2007-03-11 12:12:21,379 WARN [main] [] misc - LC.get(debug_disable_filter) was null, returning empty string
2007-03-11 12:12:21,379 WARN [main] [] misc - LC.get(debug_disable_message_analysis) was null, returning empty string
2007-03-11 12:12:21,379 WARN [main] [] misc - LC.get(debug_disable_mime_part_extraction) was null, returning empty string
2007-03-11 12:12:21,379 WARN [main] [] misc - LC.get(debug_disable_indexing) was null, returning empty string
2007-03-11 12:12:21,389 WARN [main] [] misc - LC.get(debug_disable_objects) was null, returning empty string
2007-03-11 12:12:21,389 WARN [main] [] misc - LC.get(debug_disable_indexing_attachments_separate ly) was null, returning empty string
2007-03-11 12:12:21,390 WARN [main] [] misc - LC.get(debug_disable_indexing_attachments_together ) was null, returning empty string
2007-03-11 12:12:21,390 WARN [main] [] misc - LC.get(debug_disable_mailbox_group) was null, returning empty string
2007-03-11 12:12:21,585 INFO [main] [] extensions - Loading extensions from /opt/zimbra/lib/ext
2007-03-11 12:12:21,602 INFO [main] [] extensions - extension com.zimbra.clam.ClamScanner found in /opt/zimbra/lib/ext/clamscanner/clamscanner.jar
2007-03-11 12:12:21,603 INFO [main] [] extensions - Initializing extensions
2007-03-11 12:12:21,826 INFO [main] [] ClamScanner - attachment scan is disabled
2007-03-11 12:12:22,442 INFO [main] [] extensions - Initialized extension clamscanner: com.zimbra.clam.ClamScanner@com.zimb...tensio n.ZimbraExtensionClassLoader@7e75d2
2007-03-11 12:12:24,590 INFO [IndexWritersSweeper] [] MailboxIndex - IndexWritersSweeper thread starting
2007-03-11 12:12:25,980 INFO [main] [] RedoLogManager - Starting pre-startup crash recovery
2007-03-11 12:12:27,765 INFO [main] [] RedoPlayer - No uncommitted transactions to redo
2007-03-11 12:12:27,790 INFO [main] [] RedoLogManager - Finished pre-startup crash recovery
2007-03-11 12:12:28,245 INFO [NOTIFY-7035-Server] [] misc - starting server loop
2007-03-11 12:12:28,414 INFO [LmtpServer] [] TcpServer/7025 - starting accept loop
2007-03-11 12:12:28,705 INFO [Pop3Server] [] TcpServer/110 - starting accept loop
2007-03-11 12:12:28,746 INFO [Pop3Server] [] TcpServer/995 - starting accept loop
2007-03-11 12:12:29,029 INFO [ImapServer] [] TcpServer/143 - starting accept loop
2007-03-11 12:12:29,038 INFO [ImapSSLServer] [] TcpServer/993 - starting accept loop
2007-03-11 12:12:29,602 INFO [main] [] soap - Servlet AdminServlet starting up
2007-03-11 12:12:30,402 INFO [main] [] soap - Adding service AdminService to AdminServlet
2007-03-11 12:12:30,507 INFO [main] [] soap - Adding service AccountService to AdminServlet
2007-03-11 12:12:30,508 INFO [main] [] soap - Adding service MailService to AdminServlet
2007-03-11 12:12:30,511 INFO [main] [] soap - Adding service IMService to AdminServlet
2007-03-11 12:12:30,544 INFO [main] [] ContentServlet - Servlet ContentServlet starting up
2007-03-11 12:12:30,554 INFO [main] [] PublicICalServlet - Servlet PublicICalServlet starting up
2007-03-11 12:12:30,571 INFO [main] [] account - Servlet PreAuthServlet starting up
2007-03-11 12:12:31,105 INFO [main] [] mailbox - Servlet UserServlet starting up
2007-03-11 12:12:31,191 INFO [main] [] FileUploadServlet - Servlet FileUploadServlet starting up
2007-03-11 12:12:31,223 INFO [main] [] StatsImageServlet - Servlet StatsImageServlet starting up
----

[jholder]

You need more RAM my friend.
Even 512 is cutting it close.


As for why it was working. . .when it comes to the world of memory management, it's difficult to tell sometimes.
-john

[seravitae]

Okay.. i'll look for another solution then. I look forward to using zimbra in the future should my server decide to upgrade itself for free

P.S: software should only care about how much ram it has for performance, not functionality

[seravitae]

after deciding to remove zimbra I realised one of my customers has some data they really need to access, some financial records. I just stopped as many other processes as I could and restarted but I get this:

Host localhost
antispam Running
antivirus Running
imapproxy Running
ldap Running
logger Stopped
zmlogswatchctl is not running
mailbox Stopped
tomcat is not running
mta Running
snmp Stopped
swatch is not running
spell Running

I dont get this.. You're telling me i need more ram, yet when I free up more ram, *more* services fail?....... somethings not right here.

[jholder]

Originally Posted by seravitae

after deciding to remove zimbra

I'm a little unclear on this, did you remove it or not? If you removed it, are you operating on a backup? Is so, that's a different issue.

I dont get this.. You're telling me i need more ram, yet when I free up more ram, *more* services fail?....... somethings not right here.

Let's think this through:
Are you only in terminal mode? if so, that's good. Stop x, kde, and gnome.
KDE can easiely use up 110MB by itself. I don't know how much gnome can use up, but I would guess it's in the ball park.

The thing to remember is that a system will do what ever you want it to do.
It doesn't care how much RAM you have. So, when we talk in terms of memory management, we talk reliability.

The question isn't whether you have enough RAM to run Zimbra, the question is whether you have enough RAM to run Zimbra reliably-which the answer is no.

You can not expect a system with memory issues to log things reliably. Tomcat itself can use 300MB memory on a system with 30 users.

Now, if you stop any unused processes, you might be able to get your data by:
zmcontrol stop
su -root
ps auww | grep zimbra
kill anything left over
su -zimbra
ldap start
mysql.server start
postfix start
tomcat start

That should give you enough to get your data.

Now, once you get your data, you might be able to downgrade to >3.0.1 and run with some sense of reliability. . .while you wait for your server to grow new RAM.

Good luck,
john

[seravitae]

Hey,
when I meant decided to remove i meant that I would not be buying more ram, and would find another more trim solution for now.

Your commands worked but i had to bring up MTA as well otherwise the mailbox service wouldn't work.

thanks a lot for the quick replies and help