Stop Mail Changing Port for E-Mail Account
Make sure you've switched off the new 'Automatically Maintain' settings that appeared with Yosemite.

Two places, outgoing &amp; incoming...  

for each account



and for each Outgoing Server