Problem starting up Zimbra

[richard-hdd]

Hi,

I was following this article http://www.zimbra.com/blog/archives/...er_server.html to test the backup restoration process. Our mail server is on mail.hddbroker.com and I created a server called mailbackup.hddbroker.lan. I followed the directions I used the ZmSetServerName on the mailbackup server.

At some point during this process someone in our office called me to say that they were having problems accessing the mail server (mail.hddbroker.com). When I checked the mail server status via zmcontrol status, it showed:

[zimbra@mail ~]$ zmcontrol status
Unable to determine enabled services from ldap.
Enabled services read from cache. Service list may be inaccurate.
Host mail.hddbroker.com
        antispam                Stopped
                zmmtaconfigctl is not running
                zmamavisdctl is not running
        antivirus               Stopped
                zmmtaconfigctl is not running
                zmamavisdctl is not running
        ldap                    Stopped
        logger                  Running
        mailbox                 Stopped
                zmmtaconfigctl is not running
                mysql.server is not running
                tomcat is not running
        mta                     Stopped
                zmmtaconfigctl is not running
                postfix is not running
                zmsaslauthdctl is not running
        snmp                    Stopped
                swatch is not running
        spell                   Stopped
                zmapachectl is not running
        stats                   Stopped

Thinking that it was something simple that a restart would fix, I stopped Zimbra and then started it again and this is what I have now:

[zimbra@mail ~]$ zmcontrol stop
[zimbra@mail ~]$ zmcontrol start
Host mail.hddbroker.com
        Starting ldap...Done.
Unable to determine enabled services from ldap.
Enabled services read from cache. Service list may be inaccurate.
        Starting logger...Done.
        Starting mailbox...Done.
        Starting antispam...Done.
        Starting antivirus...Done.
        Starting snmp...Done.
        Starting spell...Done.
        Starting mta...Done.
        Starting stats...Done.
[zimbra@mail ~]$ zmcontrol status
Unable to determine enabled services from ldap.
Enabled services read from cache. Service list may be inaccurate.
Host mail.hddbroker.com
        antispam                Running
        antivirus               Running
        ldap                    Running
        logger                  Running
        mailbox                 Stopped
                tomcat is not running
        mta                     Running
        snmp                    Running
        spell                   Running
        stats                   Running

The only thing that I can think of was that the mailbackup install talked to our mail server and messed around with the LDAP settings and that is now causing the mailbox to stop working. If I try to stop and start tomcat itself, I get this:

[zimbra@mail ~]$ tomcat stop
[zimbra@mail ~]$ tomcat start
ERROR: problem reading config from ldap. Make sure ldap is running.

I am not sure where to look to get this resolved? I have done searches in the forums but nothing quite matches what I am experiencing. Unfortunately, the staff cannot access their mail until I can get this resolved.

Thank you.

[richard-hdd]

I read somewhere in the forums that someone tried running the /opt/zimbra/libexec/zmldapinit and it fixed his problem. So I shutdown Zimbra, ran that command started Zimbra back up and this is what I got:

[zimbra@mail ~]$ zmcontrol stop
Host mail.hddbroker.com
        Stopping stats...Done
        Stopping mta...Done
        Stopping spell...Done
        Stopping snmp...Done
        Stopping antivirus...Done
        Stopping antispam...Done
        Stopping imapproxy...Done
        Stopping mailbox...Done
        Stopping logger...Done
        Stopping ldap...Done
[zimbra@mail ~]$ /opt/zimbra/libexec/zmldapinit
Started slapd: pid 31485
adding new entry "cn=zimbra"
ldapmodify: Already exists (68)

adding new entry "cn=admins,cn=zimbra"
ldapmodify: Already exists (68)

adding new entry "uid=zimbra,cn=admins,cn=zimbra"
ldapmodify: Already exists (68)

adding new entry "cn=zimlets,cn=zimbra"
ldapmodify: Already exists (68)

adding new entry "cn=cos,cn=zimbra"
ldapmodify: Already exists (68)

adding new entry "cn=servers,cn=zimbra"
ldapmodify: Already exists (68)

adding new entry "cn=config,cn=zimbra"
ldapmodify: Already exists (68)

adding new entry "cn=default,cn=cos,cn=zimbra"
ldapmodify: Already exists (68)

[zimbra@mail ~]$ zmcontrol start
Host mail.hddbroker.com
Unable to determine enabled services from ldap.
Enabled services read from cache. Service list may be inaccurate.
        Starting logger...Done.
        Starting mailbox...Done.
        Starting antispam...Done.
        Starting antivirus...Done.
        Starting snmp...Done.
        Starting spell...Done.
        Starting mta...Done.
        Starting stats...Done.
[zimbra@mail ~]$ zmcontrol status
Unable to determine enabled services from ldap.
Enabled services read from cache. Service list may be inaccurate.
Host mail.hddbroker.com
        antispam                Running
        antivirus               Running
        ldap                    Running
        logger                  Running
        mailbox                 Running
        mta                     Running
        snmp                    Running
        spell                   Running
        stats                   Running

Everything seems to be running but it still gives that error about unable to determine enabled services from ldap. While it says everything is running, our e-mail clients cannot connect to the server and I cannot bring up the Zimbra webmail client or the Zimbra Administration portal.

Is there any log files that I can check that might explain what is going on? I have checked various log files and I can't see anything obvious.

[marcmac]

Like, all your user data could go away....

[zimbra@mail ~]$ zmcontrol start
Host mail.hddbroker.com
Starting ldap...Done.
Unable to determine enabled services from ldap.
Enabled services read from cache. Service list may be inaccurate.
Starting logger...Done.

makes me think that ldap isn't starting right, or can't be read.

Shut everything down
ps auxww | grep slapd
if it's still running, try killall -TERM slapd
then, ldap start, and ldap status

As to what caused this - what is ldap_url and ldap_master_url set to in zmlocalconfig?

It's possible that after the restore, when you ran zmsetservername, you modified the entry for your old server, in your production ldap db.

[jholder]

marc is right. You never should run ldapinit on a prod system.

Just a side note, if your ldap is gone, can you check for an openldap.bak file. It might be in /tmp

We'll need that if you wiped your ldap.

[richard-hdd]

Originally Posted by marcmac

makes me think that ldap isn't starting right, or can't be read.

Shut everything down
ps auxww | grep slapd
if it's still running, try killall -TERM slapd
then, ldap start, and ldap status

As to what caused this - what is ldap_url and ldap_master_url set to in zmlocalconfig?

Here is what I ran:

[root@mail ~]# su - zimbra

[zimbra@mail ~]$ zmcontrol stop
Host mail.hddbroker.com
        Stopping stats...Done
        Stopping mta...Done
        Stopping spell...Done
        Stopping snmp...Done
        Stopping antivirus...Done
        Stopping antispam...Done
        Stopping imapproxy...Done
        Stopping mailbox...Done
        Stopping logger...Done
        Stopping ldap...Done

[zimbra@mail ~]$ ps auxww | grep slapd
zimbra   17752  0.0  0.0  2400  432 pts/0    S+   13:35   0:00 grep slapd

[zimbra@mail ~]$ ldap start
Started slapd: pid 17995

[zimbra@mail ~]$ ldap status
slapd running pid: 17995

After ldap was running, I tried to start Zimbra again and got this:

[zimbra@mail ~]$ zmcontrol start
Host mail.hddbroker.com
Unable to determine enabled services from ldap.
Unable to determine enabled services. Cache is out of date or doesn't exist.

Here is are the values from the zmlocalconfig as well:

[zimbra@mail ~]$ zmlocalconfig ldap_url
ldap_url = ldap://mail.hddbroker.com:389

[zimbra@mail ~]$ zmlocalconfig ldap_master_url
ldap_master_url = ldap://mail.hddbroker.com:389

At the time I didn't realize that zmldapinit would cause more problems otherwise I wouldn't have run it. I originally thought it was a password problem and that this command reset the passwords. Once I get this resolved I will file a feature request that any commands like zmldapinit should warn or require confirmation before executing. If I had seen a warning message I would have canceled.

As for the openldap.bak file, I have searched the entire server and cannot find a file by that name. I have a backup of Zimbra from the day before all of this happened. Is it possible to retrieve the ldap information from that backup?

Thank you.

[richard-hdd]

I couldn't get Zimbra to co-operate so I ended up restoring the backup from the previous day which went off without a hitch. Funny thing is, I was trying to restore a backup to test the restoration process and in the end I needed to restore the backup to get my production mail server back up and running.

Has anyone ever restored a backup to a test server? I am not sure what happened to me was a fluke or if it is common. The restoration process worked fine when I had to restore the mail server but I think that is because I was restoring a backup to a server that had the exact same IP address and hostname.

Anyway, it would be nice to know that we can test backup restorations without it affecting the production server.

Thanks.