Results 1 to 10 of 10

Thread: Message duplicates in message store

  1. #1
    stopak is offline Junior Member
    Join Date
    Mar 2010
    Posts
    5
    Rep Power
    5

    Default Message duplicates in message store

    Hi,

    lately I was worried about message duplicates. After checking message store, I found about 170567 duplicates in 836065 messages. Is it possible to somehow merge them together ?

  2. #2
    phoenix is offline Zimbra Consultant & Moderator
    Join Date
    Sep 2005
    Location
    Vannes, France
    Posts
    23,470
    Rep Power
    56

    Default

    Quote Originally Posted by stopak View Post
    lately I was worried about message duplicates. After checking message store, I found about 170567 duplicates in 836065 messages. Is it possible to somehow merge them together ?
    What do you mean by "...merge them together"?
    Regards


    Bill


    Acompli: A new adventure for Co-Founder KevinH.

  3. #3
    stopak is offline Junior Member
    Join Date
    Mar 2010
    Posts
    5
    Rep Power
    5

    Default

    Well, i would like to delete all duplicates. I presume it's not as simple as deleting messages from disk. I would also have to correct MySql data. I have no idea how to do it :/

  4. #4
    Krishopper is offline Dedicated Member
    Join Date
    Dec 2006
    Location
    Minneapolis MN
    Posts
    777
    Rep Power
    9

    Default

    Lets back up for a moment.

    How did you determine that there are duplicates?

    Have you ever done any kind of copy/backup/restore/migration where you copied the /opt/zimbra directory path using cp, tar, or anything like that?
    01 Networks, LLC / Cybernetik.net
    Zimbra NE and OSS Cloud Hosting
    Shared Web Hosting
    Consulting Services

  5. #5
    stopak is offline Junior Member
    Join Date
    Mar 2010
    Posts
    5
    Rep Power
    5

    Default

    Yes, lately I was expanding disk space so I had to temporarly move whole zimbra folder. I run fdupes on /opt/zimbra/store and store results in file. Then I count all the non empty lines in file.

  6. #6
    phoenix is offline Zimbra Consultant & Moderator
    Join Date
    Sep 2005
    Location
    Vannes, France
    Posts
    23,470
    Rep Power
    56

    Default

    Quote Originally Posted by stopak View Post
    Yes, lately I was expanding disk space so I had to temporarly move whole zimbra folder. I run fdupes on /opt/zimbra/store and store results in file.
    Copying the Zimbra store doesn't cause duplicate messages.

    Quote Originally Posted by stopak View Post
    Then I count all the non empty lines in file.
    How does that determine that they are duplicate messages with exactly the same content?
    Regards


    Bill


    Acompli: A new adventure for Co-Founder KevinH.

  7. #7
    Klug's Avatar
    Klug is offline Moderator
    Join Date
    Mar 2006
    Location
    Beaucaire, France
    Posts
    2,316
    Rep Power
    13

    Default

    It's very easy to have duplicates.

    Importing PST files (differents users, same domain) causes duplicates, lots of them 8(

    There's currently no "de-dup" tool in ZCS.
    De-duplicate mailstore
    Vote: Bug 17057 – tool to consolidate duplicate e-mails

  8. #8
    stopak is offline Junior Member
    Join Date
    Mar 2010
    Posts
    5
    Rep Power
    5

    Default

    Well fdupes prints all paths to duplicate messages (It counts md5 checksum and also compers file size). If I count them I get all messages that are duplicates. Will it work if I change duplicate files to hard links ?

  9. #9
    Klug's Avatar
    Klug is offline Moderator
    Join Date
    Mar 2006
    Location
    Beaucaire, France
    Posts
    2,316
    Rep Power
    13

    Default

    We're waiting for an "official" answer from Zimbra's devs on this.

  10. #10
    soba@ukw.edu.pl is offline Special Member
    Join Date
    Jul 2011
    Posts
    146
    Rep Power
    3

    Default

    I don't understand this - why you have a duplicate messages?
    # ZCS 7.1.3 SLES11 SP1

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Remove a message from the store?
    By number9 in forum Administrators
    Replies: 1
    Last Post: 01-25-2011, 09:47 AM
  2. Emails bouncing with "Error Text: 401,'null'"
    By sholden in forum Zimbra Connector for Outlook
    Replies: 27
    Last Post: 08-20-2008, 04:59 PM
  3. Using a message store backup from another server
    By entorno in forum Administrators
    Replies: 1
    Last Post: 02-22-2008, 08:42 AM
  4. Sizing of Mysql vs Message store
    By hillman in forum Administrators
    Replies: 8
    Last Post: 11-12-2007, 12:10 PM
  5. Message store hard links
    By bdbell in forum Migration
    Replies: 0
    Last Post: 05-22-2007, 06:14 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •