Hi, Luke,
You need to contact your VPS hosting company and ask them which ports are available, depending on your email account you should be able to use different ports, first I would see if you can send emails with your PC and if you can then the issue is with your VPS server blocking that email.