Use quaternions/remove gimbal lock from blender view
What I wanted was to change the TrackBall/Turntable option in File-&gt;Preferences-&gt;Input

(source: blender.org)
Also see:

What is the difference between the trackball and turntable style view modes?