Message Deduping duplicating messages
Hello,
we are experiencing problems with a feature of Zimbra 8.0.0 named "Enable Message Deduping".
The option "Enable Message Deduping" is disabled on all accounts and on all used COS settings therefore any duplicate message should get delivered. Settings are:
Code:
zimbraMessageIdDedupeCacheTimeout: 0
zimbraMessageIdDedupeCacheSize: 0
On restarting Zimbra or whenever mailboxd is restarted the following error is found in our logs on arrival of the first email
leading to many many duplicated deliveries to user mailboxes until the problem is resolved:
Code:
2013-01-16 13:19:26,970 INFO [LmtpServer-1] [name=username@domain.de;mid=18;ip=192.168.21.7;] mailop - Adding Message: id=2240, Message-ID=<C57D9C5750F92C4694AD870D770AA9C5018114AF16BE@QHPTM01.qhpt.local>, parentId=-1, folderId=2, folderName=Inbox.
2013-01-16 13:19:27,202 WARN [LmtpServer-1] [name=username@domain.de;mid=18;ip=192.168.21.7;] lmtp - try again for message from=sender@otherdomain.de,to=username@domain.de
java.lang.NullPointerException
at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.addToDedupeCache(ZimbraLmtpBackend.java:274)
at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliverMessageToLocalMailboxes(ZimbraLmtpBackend.java:613)
at com.zimbra.cs.lmtpserver.ZimbraLmtpBackend.deliver(ZimbraLmtpBackend.java:375)
at com.zimbra.cs.lmtpserver.LmtpHandler.processMessageData(LmtpHandler.java:376)
at com.zimbra.cs.lmtpserver.TcpLmtpHandler.continueDATA(TcpLmtpHandler.java:73)
at com.zimbra.cs.lmtpserver.LmtpHandler.doDATA(LmtpHandler.java:365)
at com.zimbra.cs.lmtpserver.LmtpHandler.processCommand(LmtpHandler.java:181)
at com.zimbra.cs.lmtpserver.TcpLmtpHandler.processCommand(TcpLmtpHandler.java:66)
at com.zimbra.cs.server.ProtocolHandler.processConnection(ProtocolHandler.java:188)
at com.zimbra.cs.server.ProtocolHandler.run(ProtocolHandler.java:127)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
2013-01-16 13:19:27,222 INFO [LmtpServer-1] [name=username@domain.de;mid=18;ip=192.168.21.7;] lmtp - S: 451 4.0.0 Temporary message delivery failure try again (DATA)
Our current solution is to enable message deduping for a dummy account and on restart of Zimbra send emails to it right on the restart from within the init-script to initialise the Deduping Cache.
Our assumption is that there is a problem on setting up the Message Deduping Cache which seems uninitialised right after a restart.
We can reproduce this problem on every restart but did not find the issue being addressed anywhere while the feature is being used in many production systems as it seems.
Is there an immediate fix available?
Is this a known issue?