I finally found what was wrong. I've just make sure that HTTPS was enabled for the Zimbra Web UI.
If someone have the same problem, the answer is here
Enable SSL on Zimbra
I can now browse the GAL but this SSL error persists on the BBAgent logs. Can anyone tell me if it's a normal way to run for the connector.