Zimbra offers Open Source email server software and shared calendar for Linux and the Mac
Go Back   Zimbra :: Forums > Zimbra Collaboration Suite > Administrators
Reload this Page Problems with mail search since upgrade to 6.0.1

Welcome to the Zimbra :: Forums!
Welcome, if you would like to post a comment please register. We also encourage you to explore all things Zimbra with our team and members of the community.

Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1 (permalink)  
Old 11-10-2009, 09:42 AM
Member
  
Posts: 11
Default Problems with mail search since upgrade to 6.0.1
Hi,

I'm experiencing the same problems as stated here, [SOLVED] No search results - worse after reindex - Search function ignores the messages received or sent since migration, and Reindex has no visible result.

I used to be on Release 5.0.13_GA_2791.UBUNTU8_64 UBUNTU8_64 FOSS edition, then migrated to 6.01, and today to the latest 6.0.2_GA_1912.UBUNTU8_64 UBUNTU8_64 FOSS.

Unfortunately, "zmconvertctl start" does nothing - as bin/zmconvertctl is missing on my server.

Can you please help me ?

Thanks, Fred
Reply With Quote
  #2 (permalink)  
Old 11-10-2009, 11:07 AM
Moderator
  
Posts: 1,147
Default
What errors are you seeing in the log? You really shouldn't be seeing the EXACT same error as the linked thread on a FOSS server because as you said, convertd isn't even available.
Reply With Quote
  #3 (permalink)  
Old 11-10-2009, 03:02 PM
Member
  
Posts: 11
Default
Thanks for your answer.

Of course you're right, the effect is the same, not the causes.

Funny, it's the same thing you noted on [SOLVED] Possibly corrupt index :

I have many
Code:
2009-11-10 08:23:26,825 WARN  [LmtpServer-284] [name=some.one@nowhere.com;mid=8;ip=192.168.1.7;] indexadd - Caught exception while indexing message id 32872 - indexing blocked.  Possibly corrupt index?
java.lang.NullPointerException: value cannot be null
        at org.apache.lucene.document.Field.<init>(Field.java:275)
        at org.apache.lucene.document.Field.<init>(Field.java:251)
        at com.zimbra.cs.index.LuceneIndex.addDocument(LuceneIndex.java:199)
        at com.zimbra.cs.index.MailboxIndex.indexMailItem(MailboxIndex.java:501)
        at com.zimbra.cs.mailbox.IndexHelper.indexingPartOfEndTransaction(IndexHelper.java:994)
        at com.zimbra.cs.mailbox.Mailbox.endTransaction(Mailbox.java:6592)
        at com.zimbra.cs.mailbox.IndexHelper.indexItemList(IndexHelper.java:889)
        at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItemsInternal(IndexHelper.java:359)
        at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItems(IndexHelper.java:277)
        at com.zimbra.cs.mailbox.IndexHelper.maybeIndexDeferredItems(IndexHelper.java:233)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:4169)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:4162)
        at com.zimbra.cs.mailbox.Mailbox.addMessage(Mailbox.java:4122)
        at com.zimbra.cs.filter.IncomingMessageHandler.addMessage(IncomingMessageHandler.java:116)
        at com.zimbra.cs.filter.IncomingMessageHandler.implicitKeep(IncomingMessageHandler.java:109)
        at com.zimbra.cs.filter.ZimbraMailAdapter.doDefaultFiling(ZimbraMailAdapter.java:284)
        at com.zimbra.cs.filter.ZimbraMailAdapter.executeActions(ZimbraMailAdapter.java:188)
        at org.apache.jsieve.SieveFactory.evaluate(SieveFactory.java:164)
        at com.zimbra.cs.filter.RuleManager.applyRulesToIncomingMessage(RuleManager.java:348)
        at com.zimbra.cs.filter.RuleManager.applyRulesToIncomingMessage(RuleManager.java:311)
        at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliverMessageToLocalMailboxes(ZimbraLmtpBackend.java:425)
        at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliverMessageToLocalMailboxes(ZimbraLmtpBackend.java:257)
        at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliver(ZimbraLmtpBackend.java:162)
        at com.zimbra.cs.lmtpserver.LmtpHandler.processMessageData(LmtpHandler.java:365)
        at com.zimbra.cs.lmtpserver.TcpLmtpHandler.continueDATA(TcpLmtpHandler.java:72)
        at com.zimbra.cs.lmtpserver.LmtpHandler.doDATA(LmtpHandler.java:350)
        at com.zimbra.cs.lmtpserver.LmtpHandler.processCommand(LmtpHandler.java:170)
        at com.zimbra.cs.lmtpserver.TcpLmtpHandler.processCommand(TcpLmtpHandler.java:66)
        at com.zimbra.cs.tcpserver.ProtocolHandler.processConnection(ProtocolHandler.java:175)
        at com.zimbra.cs.tcpserver.ProtocolHandler.run(ProtocolHandler.java:132)
        at EDU.oswego.cs.dl.util.concurrent.PooledExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Thread.java:619)
then some like those (after the update to 6.0.2) :
Code:
2009-11-10 22:48:04,642 INFO  [btpool0-50://somewhere.com/service/soap/SendMsgRequest] [name=some.one@nowhere.com;mid=8;ip=192.168.1.8;ua=ZimbraWebClient - FF3.0 (Linux)/6.0.2_GA_1912.
UBUNTU8_64;] mailbox - IndexDeferredItems(79190-33059, 79190): Deferred count out of sync - found=4 in progress=8 (deferred count=16)
2009-11-10 22:48:04,876 WARN  [btpool0-50://nowhere.com/service/soap/SendMsgRequest] [name=some.one@nowhere.com;mid=8;ip=192.168.1.8;ua=ZimbraWebClient - FF3.0 (Linux)/6.0.2_GA_1912.
UBUNTU8_64;] indexadd - Caught exception while indexing message id 33063 - indexing blocked.  Possibly corrupt index?
java.lang.NullPointerException: value cannot be null
        at org.apache.lucene.document.Field.<init>(Field.java:275)
        at org.apache.lucene.document.Field.<init>(Field.java:251)
        at com.zimbra.cs.index.LuceneIndex.addDocument(LuceneIndex.java:200)
        at com.zimbra.cs.index.MailboxIndex.indexMailItem(MailboxIndex.java:513)
        at com.zimbra.cs.mailbox.IndexHelper.indexingPartOfEndTransaction(IndexHelper.java:995)
        at com.zimbra.cs.mailbox.Mailbox.endTransaction(Mailbox.java:6669)
        at com.zimbra.cs.mailbox.IndexHelper.indexItemList(IndexHelper.java:890)
        at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItemsInternal(IndexHelper.java:360)
        at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItems(IndexHelper.java:278)
        at com.zimbra.cs.mailbox.IndexHelper.search(IndexHelper.java:122)
        at com.zimbra.cs.mailbox.Mailbox.search(Mailbox.java:3427)
        at com.zimbra.cs.mailbox.Mailbox.search(Mailbox.java:3394)
        at com.zimbra.cs.mailbox.ContactAutoComplete.queryFolders(ContactAutoComplete.java:400)
        at com.zimbra.cs.mailbox.ContactAutoComplete.query(ContactAutoComplete.java:213)
        at com.zimbra.cs.mailbox.ContactRankings.updateContactInfo(ContactRankings.java:125)
        at com.zimbra.cs.mailbox.ContactRankings.increment(ContactRankings.java:117)
        at com.zimbra.cs.mailbox.ContactRankings.increment(ContactRankings.java:65)
        at com.zimbra.cs.mailbox.MailSender.sendMimeMessage(MailSender.java:380)
        at com.zimbra.cs.mailbox.MailSender.sendMimeMessage(MailSender.java:280)
        at com.zimbra.cs.mailbox.MailSender.sendMimeMessage(MailSender.java:237)
        at com.zimbra.cs.service.mail.SendMsg.doSendMessage(SendMsg.java:190)
        at com.zimbra.cs.service.mail.SendMsg.handle(SendMsg.java:150)
        at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:418)
        at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:272)
        at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:156)
        at com.zimbra.soap.SoapServlet.doWork(SoapServlet.java:291)
        at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:212)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
        at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:181)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
        at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
        at org.mortbay.servlet.UserAgentFilter.doFilter(UserAgentFilter.java:81)
        at org.mortbay.servlet.GzipFilter.doFilter(GzipFilter.java:132)
        at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1148)
        at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:379)
        at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
        at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
        at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)
        at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
        at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
        at org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
        at org.mortbay.jetty.handler.rewrite.RewriteHandler.handle(RewriteHandler.java:230)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
        at org.mortbay.jetty.handler.DebugHandler.handle(DebugHandler.java:77)
        at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
        at org.mortbay.jetty.Server.handle(Server.java:324)
        at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:525)
        at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:882)
        at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:747)
        at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
        at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:387)
        at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)
        at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:451)
Going to maintenance mode, deleting the index and restarting seems to be a solution - but I'll first try to delele all the spam mail, then reindex (this box also is the catchall box - may be related ?)

Or, I'd prefer to have a good way to manage this - turning some logs on, open a bug, post things - so it can be corrected and others don't encounter this (really annoying) problem.
Reply With Quote
  #4 (permalink)  
Old 11-10-2009, 04:15 PM
Member
  
Posts: 11
Default
OK, my update...

I activate some logs for my user:
zmprov aal some.one@nowhere.com zimbra.index debug
zmprov aal some.one@nowhere.com zimbra.op debug
zmprov aal some.one@nowhere.com zimbra.misc debug
zmprov aal some.one@nowhere.com zimbra.filter debug
zmprov aal some.one@nowhere.com zimbra.mailbox debug

I didn't notice anything special in the logs while searching / using, so I launched a new Reindex from the administration.

I got some errors (alas, not really more...) and ended like this :

Code:
2009-11-11 00:51:08,128 DEBUG [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - indexMailItem(changeId=79243, token=79227-33079)
2009-11-11 00:51:08,150 DEBUG [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - indexMailItem(changeId=79243, token=79237-33081)
2009-11-11 00:51:08,150 WARN  [ReIndex-1] [name=some.one@nowhere.com;mid=8;] indexadd - Caught exception while indexing message id 33081 - indexing blocked.  Poss
ibly corrupt index?
java.lang.NullPointerException: value cannot be null
        at org.apache.lucene.document.Field.<init>(Field.java:275)
        at org.apache.lucene.document.Field.<init>(Field.java:251)
        at com.zimbra.cs.index.LuceneIndex.addDocument(LuceneIndex.java:200)
        at com.zimbra.cs.index.MailboxIndex.indexMailItem(MailboxIndex.java:513)
        at com.zimbra.cs.mailbox.IndexHelper.indexingPartOfEndTransaction(IndexHelper.java:995)
        at com.zimbra.cs.mailbox.Mailbox.endTransaction(Mailbox.java:6669)
        at com.zimbra.cs.mailbox.IndexHelper.indexItemList(IndexHelper.java:890)
        at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItemsInternal(IndexHelper.java:360)
        at com.zimbra.cs.mailbox.IndexHelper.indexDeferredItems(IndexHelper.java:278)
        at com.zimbra.cs.mailbox.IndexHelper.access$500(IndexHelper.java:54)
        at com.zimbra.cs.mailbox.IndexHelper$ReIndexTask.reIndex(IndexHelper.java:488)
        at com.zimbra.cs.mailbox.IndexHelper$ReIndexTask.run(IndexHelper.java:418)
        at com.zimbra.common.util.ThreadPool$CountedTask.run(ThreadPool.java:136)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
2009-11-11 00:51:08,301 DEBUG [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - clearing change
2009-11-11 00:51:08,302 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox - beginning operation: indexingCompleted
2009-11-11 00:51:08,302 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox -   fetching new DB connection
2009-11-11 00:51:08,302 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox - ending operation
2009-11-11 00:51:08,303 DEBUG [IndexingCompleted-1] [name=some.one@nowhere.com;mid=8;] mailbox - clearing change
2009-11-11 00:51:08,305 INFO  [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - Deferred Indexing: submitted 13747 items in 466922ms (29.44/sec). (0 items 
failed to index).  IndexDeferredCount now at 2645 NumNotSubmitted= 2452
2009-11-11 00:51:08,305 INFO  [ReIndex-1] [name=some.one@nowhere.com;mid=8;] mailbox - Re-Indexing: Mailbox 8 COMPLETED in 466935ms
Let's try...

... still no way, Search still doesn't find my recent messages.

OK, I emptied my Spam and Trash boxes.

Still not...

reindexed again...

And it works !!! I can find my recent mails again...

Phew...

If any Zimbra admin is interested, I have a full backup from the server before the 6.0.1 to 6.0.2 upgrade. I also save my mailbox.log for reference.
Reply With Quote
  #5 (permalink)  
Old 11-11-2009, 10:19 AM
Moderator
  
Posts: 1,147
Default
Yea I thought maybe it was just something strange with my server, but since you are seeing the exact same thing I think I will open a bug report with a message file that causes this attached.
Reply With Quote
  #6 (permalink)  
Old 11-11-2009, 11:20 AM
Moderator
  
Posts: 1,147
Default
Filed Bug 42599 - Message causes NPE on ReIndex - indexing blocked.
Reply With Quote
  #7 (permalink)  
Old 11-13-2009, 11:57 PM
Member
  
Posts: 11
Default
Great, thanks !
Of course my own messages are available if needed. They're also spam messages...
Reply With Quote
Reply

« Previous Thread | Today's Posts or Week's Posts | Next Thread »

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Linear Mode Linear Mode


Similar Threads

Product Information

Why Join?

Registering let's you ask questions, makes it easier to search, displays any files attached to posts, and notifies you about replies.

blog.zimbra.com


Home - Blog - Contact Us - Archive - Top


 

SEO by vBSEO ©2011, Crawlability, Inc.