Mail can't connect to... non-existing account
After trying all sorts of things with Keychain and other devices I finally figured out what is causing this. The offending 'account' was in the SMTP list. You can find this by going to 'Preferences' in the Mail app, select the 'Accounts' tab, click on the dropdown for 'Outgoing Mail Server' and there you can 'Edit SMTP Server list'.