well, I guess it was due to the DNS, the dns may not be working properly and 20 email was gathering in to the queue. When DNS starts working properly emails were deliver to that email server.
Which spam filter was used at remote end, I think your IP address should be blocked by some of the lookups provider services, it can happen if at your end or at service provider end NAT is used. Please check your IP in
http://www.spamhaus.org/xbl/index.lasso
Regards
Adeel