You might not be wrong.
It depends on whether you have a registered domain name and whether you're on a fixed IP and whether you want inbound mail delivered directly to your server and whether you want outbound mail delivered directly or relayed through ISP. Tell me those answers and I can point you in the right direction.