Page 1 of 2 12 LastLast
Results 1 to 10 of 15

Thread: Daily Mail Report - missing data

  1. #1
    klinet's Avatar
    klinet is offline Intermediate Member
    Join Date
    Jun 2007
    Location
    Chicago
    Posts
    19
    Rep Power
    8

    Default Daily Mail Report - missing data

    My daily mail report seems to be working only in the afternoon.

    The per hour traffic summary does not begin until 2PM.

    See attachment

    Anyone have any thoughts?

    Thanks
    Todd
    Attached Images Attached Images

  2. #2
    LMStone's Avatar
    LMStone is offline Moderator
    Join Date
    Sep 2006
    Location
    477 Congress Street | Portland, ME 04101
    Posts
    1,367
    Rep Power
    10

    Default

    FWIW we are seeing the exact same thing, except the start-of-data-time for us is different.

    We've been busy sorting out more pressing issues from our recent Zimbra upgrade (see ), so haven't gotten to this problem fully just yet since we only got stats back working properly yesterday.

    So far, what we see is that the logs /var/log/zimbra*.log seem to be getting rotated around 6:15pm our time. Our server's hardware clocks are set to UTC, and our Time Zone on the servers (and in Zimbra) is set to Eastern, i.e. GMT -4 (daylight savings time).

    We'll look at the logrotation scripts and confirm system time later and report back here whatever we find.

    Curious what time zone your system is configured for and if the number of hours difference in our respective start-of-data-times in the daily mail report matches exactly with the hours difference between our two time zones.

    Hope that helps,
    Mark

  3. #3
    klinet's Avatar
    klinet is offline Intermediate Member
    Join Date
    Jun 2007
    Location
    Chicago
    Posts
    19
    Rep Power
    8

    Default

    Thanks for the info, I think you may be onto something with the log rotation times. I see that you are also using SLES 10x64. We are in Central time, so if you are seeing a one hour difference in the start of your hourly info then I think we have a good place to be looking. This is also a low priority for us, but still looking at it as time permits.

    Thanks
    Todd

  4. #4
    LMStone's Avatar
    LMStone is offline Moderator
    Join Date
    Sep 2006
    Location
    477 Congress Street | Portland, ME 04101
    Posts
    1,367
    Rep Power
    10

    Default

    I think I have identified the root cause of this issue...

    I looked at the time stamps for the /var/log/*.bz2 files on about a dozen SLES systems this morning (some Zimbra hosts, some not), and saw that the log files being rotated by scripts in /etc/cron.daily had time stamps of roughly on the hour and fifteen/thirty/forty-five minutes after the hour -- and that the hours were all pretty random. There was no correlation between time zones at all.

    I also noticed that the time of day the files were rotated changed by an hour when Daylight Savings Time kicked in.

    The new Zimbra logging system as I understand it, including the daily mail report and statistics in the Admin console, relies on data in /var/log/zimbra.log and /var/log/zimbra-stats.log being available to parse.

    When these log files are rotated in the middle of the day, the data in the daily mail report and stats in the Admin Console is incomplete.

    So why are these log files being rotated by scripts in /etc/cron.daily on such a seemingly random basis?

    Because unless the "DAILY_TIME" parameter in /etc/sysconfig/cron is set to a specific time, cron.daily is run by default at the next 15 minute interval past the last boot time hour -- until the server is once again rebooted.

    On all the SLES systems I looked at, "DAILY_TIME" was blank.

    Consequently, /etc/cron.daily/zimbra is being executed each day based on the last boot time of the server.

    This is not what Zimbra I believe intends so I have filed a bug report here: Bug 43847 – Incorrect Log File Rotation Method Causing Missing Data in Daily Admin Report and Admin Console Stats Pages

    Would be interesting if admins using other distros could comment on their setups here as well...

    Hope that helps,
    Mark

  5. #5
    uxbod's Avatar
    uxbod is offline Moderator
    Join Date
    Nov 2006
    Location
    UK
    Posts
    8,017
    Rep Power
    24

    Default

    Mark,

    on CentOS it is controller by /etc/crontab
    Code:
    02 4 * * * root run-parts /etc/cron.daily

  6. #6
    LMStone's Avatar
    LMStone is offline Moderator
    Join Date
    Sep 2006
    Location
    477 Congress Street | Portland, ME 04101
    Posts
    1,367
    Rep Power
    10

    Default

    Quote Originally Posted by uxbod View Post
    Mark,

    on CentOS it is controller by /etc/crontab
    Code:
    02 4 * * * root run-parts /etc/cron.daily
    Thanks for posting that!

    So, are there time periods in your daily mail report that are missing data?

    All the best,
    Mark

  7. #7
    phoenix is online now Zimbra Consultant & Moderator
    Join Date
    Sep 2005
    Location
    Vannes, France
    Posts
    23,501
    Rep Power
    57

    Default

    Quote Originally Posted by LMStone View Post
    So, are there time periods in your daily mail report that are missing data?
    Not on my CentOS server, there is received mail in all the time slots.
    Regards


    Bill


    Acompli: A new adventure for Co-Founder KevinH.

  8. #8
    LMStone's Avatar
    LMStone is offline Moderator
    Join Date
    Sep 2006
    Location
    477 Congress Street | Portland, ME 04101
    Posts
    1,367
    Rep Power
    10

    Default

    Quote Originally Posted by phoenix View Post
    Not on my CentOS server, there is received mail in all the time slots.
    Well, we'll see what happens in two days then!

    Thanks Bill,
    Mark

    P.S. Unsupported OS eh?

  9. #9
    phoenix is online now Zimbra Consultant & Moderator
    Join Date
    Sep 2005
    Location
    Vannes, France
    Posts
    23,501
    Rep Power
    57

    Default

    Quote Originally Posted by LMStone View Post
    P.S. Unsupported OS eh?
    Of course but I don't get support for my installation anyway.
    Regards


    Bill


    Acompli: A new adventure for Co-Founder KevinH.

  10. #10
    jrefl5 is offline Advanced Member
    Join Date
    Nov 2007
    Location
    AZ, USA
    Posts
    205
    Rep Power
    7

    Default

    Like uxbod, and phoenix I don't have any problems, but then I'm also on CENTOS.

    you might want to try to set a reasonable time in "DAILY_TIME".

    the zmdailyreport attempts to open both the current zimbra.log, and zimbra.log.1 or zimbra.log.1.gz so it should be able to get the prior day.
    Last edited by jrefl5; 01-06-2010 at 02:25 PM.

Page 1 of 2 12 LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Similar Threads

  1. Replies: 7
    Last Post: 02-03-2011, 07:01 AM
  2. Large volume of spam messages; see the log
    By snake_eyes in forum Administrators
    Replies: 1
    Last Post: 12-31-2008, 06:54 AM
  3. Migration Assistance
    By dwill in forum Administrators
    Replies: 10
    Last Post: 12-02-2008, 08:20 AM
  4. DynDNS and Zimbra
    By afterwego in forum Installation
    Replies: 30
    Last Post: 04-01-2007, 03:34 PM
  5. Traslation SVN tree status
    By meikka in forum I18N/L10N - Translations
    Replies: 7
    Last Post: 02-13-2007, 11:13 AM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •