Massive CPU Usage, ZDB Filled Up Disk

[y@w]

I noticed on Friday that one of our BES servers was consuming a ton of CPU and not delivering messages very quickly. The CalHelper.exe process was consuming a majority of the CPU. I put Outlook into debug mode and found a bunch of entries like this:

07-11-2009 12:47:41.668 [3532]: DEBUG: Zimbra::Rpc::UserSession::GetSupportObject - m_pMapiSup = 0000000000
07-11-2009 12:47:41.668 [3532]: Zimbra::Store::Wrappers::IMSProviderWrapperImpl::CompareStoreIDs. done. hr: 0x0
07-11-2009 12:47:41.668 [3532]: Zimbra::Store::Wrappers::IMSProviderWrapperImpl::CompareStoreIDs. flags: 0x0
07-11-2009 12:47:41.668 [3532]: Zimbra::Store::Wrappers::IMSProviderWrapperImpl::CompareStoreIDs. the entry ids do not refer to the same store
07-11-2009 12:47:41.668 [3532]: Zimbra::Store::Wrappers::IMSProviderWrapperImpl::CompareStoreIDs. first entry id: 000000004e495441f9bfb80100aa0037d96e0000000043003a005c0044006f00630075006d0065006e0074007300200061006e0064002000530065007400740069006e00670073005c00410064006d0069006e006900730074007200610074006f0072005c004c006f00630061006c002000530065007400740069006e00670073005c004100700070006c00690063006100740069006f006e00200044006100740061005c004d006900630072006f0073006f00660074005c004f00750074006c006f006f006b005c0042006c00610063006b00420065007200720079005300650072007600650072002e007a00640062000000
07-11-2009 12:47:41.668 [3532]: Zimbra::Store::Wrappers::IMSProviderWrapperImpl::CompareStoreIDs. second entry id: 000000004e495441f9bfb80100aa0037d96e0000000043003a005c0044006f00630075006d0065006e0074007300200061006e0064002000530065007400740069006e00670073005c00410064006d0069006e006900730074007200610074006f0072005c004c006f00630061006c002000530065007400740069006e00670073005c004100700070006c00690063006100740069006f006e00200044006100740061005c004d006900630072006f0073006f00660074005c004f00750074006c006f006f006b005c0042006c00610063006b00420065007200720079005300650072007600650072002e007a00640062000000

Today, the disk filled up The BlackBerry Server zdb file blew up to 20GB in size. I'm running the scanpst tool on the file right now. Has anyone else seen this and is there any recovering?

[fsiegel]

I'm starting to hear of other instances where the zdb is growing in size. Also, I don't think the support object should be 0 -- that could be part of the problem. If there are other instances in the log where you see the support id is 0, I'd like to see them. Investigating...

[y@w]

Originally Posted by fsiegel

I'm starting to hear of other instances where the zdb is growing in size. Also, I don't think the support object should be 0 -- that could be part of the problem. If there are other instances in the log where you see the support id is 0, I'd like to see them. Investigating...

Thanks for the response. I ended up having to open up a support case because it was customer-impacting and I couldn't figure it out. It's case # 00045640.

Here's the info I've got so far:

- BlackBerryServer.zdb exploded to *nearly* 20GB
- The file got currupted either from the filled disk or the corruption caused the growth (not sure yet)
- I used the scanpst.exe tool to repair the corrupted file and it hasn't grown since starting services back up again

After repairing and starting services, we're back up and running. The file is pretty dang close to 20GB though, which leaves me worried that it could happen again and quickly become too big. The nearly part of the nearly 20GB is important, because evidently there's a 20GB limit to PST's (which in hindsight, running out of disk space may have prevented us from hitting).

Anyway, support is working with me now to see if we can reduce the size and figure out what happened so I will post back what we figure out.

[fsiegel]

ZCO has a Compact ZDB button in the mail applet. I don't believe ZCB has that. You might check, though.