How do I get Safari to always display the tab bar?
As it turns out, you do this through the "View" menu, rather than through "Preferences":


Close all tabs but one, so you only have one tab open
In the "View" menu, click "Show Tab Bar" which will make the tab bar appear
This preference will stick, even if you close and reopen Safari


Simple, but not what I expected!