Zimbra offers Open Source email server software and shared calendar for Linux and the Mac
 
Go Back   Zimbra - Forums > Zimbra Collaboration Suite > Administrators

Welcome to the Zimbra - Forums!
Welcome, if you would like to post a comment please register. We also encourage you to explore all things Zimbra with our team and members of the community.

Reply
 
LinkBack Thread Tools Display Modes
  #11 (permalink)  
Old 08-29-2006, 08:51 AM
Advanced Member
 
Posts: 232
Default

Here is the detail of a service restart on Zimbra:

[root@webmail ~]# service zimbra restart
Host webmail.avmax-internal.net
Stopping antispam...Done
Stopping antivirus...Done
Stopping imapproxy...Done
Stopping ldap...Done
Stopping logger...Done
Stopping mailbox...FAILED
Killing mysqld with pid 3842 .............................. gave up waiting!
Using CATALINA_BASE: /opt/zimbra/tomcat
Using CATALINA_HOME: /opt/zimbra/tomcat
Using CATALINA_TMPDIR: /opt/zimbra/tomcat/temp
Using JRE_HOME: /opt/zimbra/java
Waiting ..... trying again
Using CATALINA_BASE: /opt/zimbra/tomcat
Using CATALINA_HOME: /opt/zimbra/tomcat
Using CATALINA_TMPDIR: /opt/zimbra/tomcat/temp
Using JRE_HOME: /opt/zimbra/java
Waiting ..... trying again
Using CATALINA_BASE: /opt/zimbra/tomcat
Using CATALINA_HOME: /opt/zimbra/tomcat
Using CATALINA_TMPDIR: /opt/zimbra/tomcat/temp
Using JRE_HOME: /opt/zimbra/java
Waiting ..... trying again
Using CATALINA_BASE: /opt/zimbra/tomcat
Using CATALINA_HOME: /opt/zimbra/tomcat
Using CATALINA_TMPDIR: /opt/zimbra/tomcat/temp
Using JRE_HOME: /opt/zimbra/java
Waiting ..... trying again
Giving up - killing 4086


Stopping mta...Done
Stopping snmp...Done
Stopping spell...Done
Host webmail.avmax-internal.net
Starting ldap...Done.
Starting antispam...Done.
Starting antivirus...Done.
Starting logger...Done.
Starting mailbox...Done.
Starting mta...Done.
Starting snmp...Done.
Starting spell...Done.
[root@webmail ~]#
__________________
Cheers,

Travis

"Let's look at this from a standpoint of "Status". What exactly, on the Space Craft, IS working?"
-Flight Control, Apollo 13
Reply With Quote
  #12 (permalink)  
Old 08-29-2006, 09:28 AM
Advanced Member
 
Posts: 232
Default

This is an error I get now when I try and delete from the Que:

Message: system failure: exception occurred performing queue action
com.zimbra.cs.service.ServiceException: system failure: exception occurred performing queue action
at com.zimbra.cs.service.ServiceException.FAILURE(Ser viceException.java:131)
at com.zimbra.cs.rmgmt.RemoteMailQueue.action(RemoteM ailQueue.java:574)
at com.zimbra.cs.service.admin.MailQueueAction.handle (MailQueueAction.java:83)
at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEng ine.java:255)
at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.jav a:163)
at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.jav a:84)
at com.zimbra.soap.SoapServlet.doPost(SoapServlet.jav a:228)
at javax.servlet.http.HttpServlet.service(HttpServlet .java:709)
at com.zimbra.cs.servlet.ZimbraServlet.service(Zimbra Servlet.java:154)
at javax.servlet.http.HttpServlet.service(HttpServlet .java:802)
at org.apache.catalina.core.ApplicationFilterChain.in ternalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.do Filter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invo ke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invo ke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke( StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke (ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invok e(StandardEngineValve.java:107)
at org.apache.catalina.valves.AccessLogValve.invoke(A ccessLogValve.java:541)
at org.apache.catalina.connector.CoyoteAdapter.servic e(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(H ttp11Processor.java:869)
at org.apache.coyote.http11.Http11BaseProtocol$Http11 ConnectionHandler.processConnection(Http11BaseProt ocol.java:667)
at org.apache.tomcat.util.net.PoolTcpEndpoint.process Socket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThr ead.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlR unnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
Caused by: java.io.IOException: Lock obtain timed out: Lock@/opt/zimbra/apache-tomcat-5.5.1...726-write.lock
at org.apache.lucene.store.Lock.obtain(Lock.java:58)
at org.apache.lucene.index.IndexReader.aquireWriteLoc k(IndexReader.java:408)
at org.apache.lucene.index.IndexReader.delete(IndexRe ader.java:432)
at org.apache.lucene.index.IndexReader.delete(IndexRe ader.java:454)
at com.zimbra.cs.rmgmt.RemoteMailQueue.action(RemoteM ailQueue.java:563)
... 23 more

Error code: service.FAILURE
Method: ZmCsfeCommand.prototype.invoke
Details:soap:Receiver
__________________
Cheers,

Travis

"Let's look at this from a standpoint of "Status". What exactly, on the Space Craft, IS working?"
-Flight Control, Apollo 13
Reply With Quote
  #13 (permalink)  
Old 08-29-2006, 09:58 AM
Zimbra Consultant & Moderator
 
Posts: 11,508
Default

Is there a possibility that you've had a DNS failure when this happens? Have you checked the permissions on the /opt/zimbra directories?
__________________
Regards


Bill
Reply With Quote
  #14 (permalink)  
Old 08-29-2006, 10:02 AM
Advanced Member
 
Posts: 232
Default

Hi Bill,

I have ran the zmfixperms each morning just to make sure.

DNS is working.

I can no longer manage my que via the Admin console as each "Delete, Hold, Reque" command generates an error like the one I posted here.

I have 762 messages in the que that don't seem to be going anywhere.

Should I try a postqueue -f ?
__________________
Cheers,

Travis

"Let's look at this from a standpoint of "Status". What exactly, on the Space Craft, IS working?"
-Flight Control, Apollo 13
Reply With Quote
  #15 (permalink)  
Old 08-29-2006, 10:12 AM
Zimbra Consultant & Moderator
 
Posts: 11,508
Default

Yes, I'd try the flush on the queue. Is there anything that might have precipitated this problem? Any system upgrades? Has it been happening for long?
__________________
Regards


Bill

Last edited by phoenix : 05-20-2008 at 11:46 PM.
Reply With Quote
  #16 (permalink)  
Old 08-29-2006, 10:19 AM
Advanced Member
 
Posts: 232
Default

About 5 days now. Everynight I look at the que and it is empty....every morning it is between 500 and 600 messages backlogged.

I am sure 80% of it is SPAM, but 500 or 600 messages should not be a problem to deliver right?

I think the problem is not "volume", but rather it gets backlogged, for a reason I have not figured out yet.

What about the failures when I try and manage the queue? Like if I wanted to put half on hold and give it a chance to "catch up"?
__________________
Cheers,

Travis

"Let's look at this from a standpoint of "Status". What exactly, on the Space Craft, IS working?"
-Flight Control, Apollo 13
Reply With Quote
  #17 (permalink)  
Old 08-29-2006, 11:33 AM
Advanced Member
 
Posts: 232
Default

Is it normal to have this activity in /tmp ?

[root@webmail tmp]# pwd
/tmp
[root@webmail tmp]# ls -al
total 860
drwxrwxrwt 18 root root 4096 Aug 29 11:32 .
drwxr-xr-x 23 root root 4096 Aug 29 10:59 ..
-r--r--r-- 1 root root 1535 May 25 13:13 crontab.zimbra
drwxrwxrwt 2 root root 4096 Aug 29 11:00 .font-unix
-rw-r--r-- 1 zimbra zimbra 362937 Aug 29 11:11 gengraphs.out
drwxr-xr-x 2 zimbra zimbra 4096 Aug 28 23:00 ham.17120
drwxr-xr-x 2 zimbra zimbra 4096 Aug 23 23:00 ham.20909
drwxr-xr-x 2 zimbra zimbra 4096 Aug 27 23:00 ham.23751
drwxr-xr-x 2 zimbra zimbra 4096 Aug 24 23:00 ham.28769
drwxr-xr-x 2 zimbra zimbra 4096 Aug 22 23:00 ham.6312
drwxr-x--- 2 root root 4096 Aug 29 11:29 hsperfdata_root
drwxr-xr-x 2 zimbra zimbra 4096 Aug 29 11:32 hsperfdata_zimbra
drwxrwxrwt 2 root root 4096 Aug 29 10:59 .ICE-unix
-rw-r--r-- 1 zimbra zimbra 352256 Aug 29 11:32 logprocess.out
-rwxrwxrwx 1 zimbra zimbra 81 Aug 29 11:00 logswatch.out
drwxr-xr-x 2 zimbra zimbra 4096 Aug 28 23:00 spam.17120
drwxr-xr-x 2 zimbra zimbra 4096 Aug 23 23:00 spam.20909
drwxr-xr-x 2 zimbra zimbra 4096 Aug 27 23:00 spam.23751
drwxr-xr-x 2 zimbra zimbra 4096 Aug 24 23:00 spam.28769
drwxr-xr-x 2 zimbra zimbra 4096 Aug 22 23:00 spam.6312
-rw-rw---- 1 zimbra zimbra 770 Aug 29 11:32 #sql_de8_0.MYD
-rw-rw---- 1 zimbra zimbra 1024 Aug 29 11:32 #sql_de8_0.MYI
-rwxrwxrwx 1 zimbra zimbra 78 Aug 29 11:01 swatch.out
-rw-rw-r-- 1 zimbra zimbra 2970 Aug 24 08:13 .swatch_script.3310
-rw-rw-r-- 1 zimbra zimbra 2970 Aug 28 09:43 .swatch_script.3327
-rw-rw-r-- 1 zimbra zimbra 2970 Aug 25 13:49 .swatch_script.3337
-rw-rw-r-- 1 zimbra zimbra 2970 Aug 29 11:00 .swatch_script.3493
-rw-rw-r-- 1 zimbra zimbra 4907 Aug 24 08:13 .swatch_script.4468
-rw-rw-r-- 1 zimbra zimbra 4907 Aug 29 11:01 .swatch_script.4475
-rw-rw-r-- 1 zimbra zimbra 4907 Aug 25 13:49 .swatch_script.4478
-rw-rw-r-- 1 zimbra zimbra 4907 Aug 23 08:20 .swatch_script.4680
drwxr-x--- 6 zimbra zimbra 4096 Aug 28 08:35 zimbra
drwxr-xr-x 21 root root 4096 May 25 13:05 zimbrabackup
-rw-r--r-- 1 zimbra zimbra 0 Aug 29 10:52 zmcontrol_err.26090
-rw-rw-r-- 1 zimbra zimbra 32 Aug 25 09:57 zmcontrol.out.2407
-rw-r--r-- 1 zimbra zimbra 0 Aug 29 10:52 zmcontrol_status.26090
__________________
Cheers,

Travis

"Let's look at this from a standpoint of "Status". What exactly, on the Space Craft, IS working?"
-Flight Control, Apollo 13
Reply With Quote
  #18 (permalink)  
Old 08-29-2006, 11:40 AM
Zimbra Consultant & Moderator
 
Posts: 11,508
Default

I have a couple of swatch.scripts & the gengraphs.out files but that's about it. 'Normal', I don't know about that - I'd make a wild guess and say they're just leftover files but it would only be a guess. Have you tried deleting the older files? Have you made any changes to your services such as amavis etc. that are running in zimbra? I assume everything is still up as normal? Has the server been rebooted since this problem started? I would guess you have as that normaly one of my first choices.
__________________
Regards


Bill
Reply With Quote
  #19 (permalink)  
Old 08-29-2006, 11:45 AM
Advanced Member
 
Posts: 232
Default

Many many reboots....

No changes made to anything, although I am now working on upgrading to the latest release of FC3.
__________________
Cheers,

Travis

"Let's look at this from a standpoint of "Status". What exactly, on the Space Craft, IS working?"
-Flight Control, Apollo 13
Reply With Quote
  #20 (permalink)  
Old 08-29-2006, 12:06 PM
Advanced Member
 
Posts: 232
Default

Latest upgrade applied, still same problem.

If I could only put some messages on hold, it may help. I cannot however do any que management without errors being generated. This is what I get if I try and put a message on hold, delete or reque:

Message: system failure: exception occurred performing queue action
com.zimbra.cs.service.ServiceException: system failure: exception occurred performing queue action
at com.zimbra.cs.service.ServiceException.FAILURE(Ser viceException.java:131)
at com.zimbra.cs.rmgmt.RemoteMailQueue.action(RemoteM ailQueue.java:574)
at com.zimbra.cs.service.admin.MailQueueAction.handle (MailQueueAction.java:83)
at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEng ine.java:255)
at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.jav a:163)
at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.jav a:84)
at com.zimbra.soap.SoapServlet.doPost(SoapServlet.jav a:228)
at javax.servlet.http.HttpServlet.service(HttpServlet .java:709)
at com.zimbra.cs.servlet.ZimbraServlet.service(Zimbra Servlet.java:154)
at javax.servlet.http.HttpServlet.service(HttpServlet .java:802)
at org.apache.catalina.core.ApplicationFilterChain.in ternalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.do Filter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invo ke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invo ke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke( StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke (ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invok e(StandardEngineValve.java:107)
at org.apache.catalina.valves.AccessLogValve.invoke(A ccessLogValve.java:541)
at org.apache.catalina.connector.CoyoteAdapter.servic e(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(H ttp11Processor.java:869)
at org.apache.coyote.http11.Http11BaseProtocol$Http11 ConnectionHandler.processConnection(Http11BaseProt ocol.java:667)
at org.apache.tomcat.util.net.PoolTcpEndpoint.process Socket(PoolTcpEndpoint.java:527)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThr ead.runIt(LeaderFollowerWorkerThread.java:80)
at org.apache.tomcat.util.threads.ThreadPool$ControlR unnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
Caused by: java.io.IOException: Lock obtain timed out: Lock@/opt/zimbra/apache-tomcat-5.5.1...726-write.lock
at org.apache.lucene.store.Lock.obtain(Lock.java:58)
at org.apache.lucene.index.IndexReader.aquireWriteLoc k(IndexReader.java:408)
at org.apache.lucene.index.IndexReader.delete(IndexRe ader.java:432)
at org.apache.lucene.index.IndexReader.delete(IndexRe ader.java:454)
at com.zimbra.cs.rmgmt.RemoteMailQueue.action(RemoteM ailQueue.java:563)
... 23 more

Error code: service.FAILURE
Method: ZmCsfeCommand.prototype.invoke
Details:soap:Receiver
__________________
Cheers,

Travis

"Let's look at this from a standpoint of "Status". What exactly, on the Space Craft, IS working?"
-Flight Control, Apollo 13
Reply With Quote
Reply


Thread Tools
Display Modes


Similar Threads

Why Join?

Registering let's you ask questions, makes it easier to search, displays any files attached to posts, and notifies you about replies.

Zimbrablog.com




 

Search Engine Optimization by vBSEO 3.1.0