How to keep the view from snapping to another location when exiting camera view?
Disable the Auto-Depth option in User Preferences > Interface.



There will be still a small jump in the transition but not that big.
Also making your scene larger will help.