How to set-up the perspective view based on a reference image?
As an alternative to background images (which can't be displayed in perspective), you could use an Image empty (ShiftA> Empty > Image). 

Image empties can be rotated, scaled, and translated just like any other object.

You can make empties transparent by adjusting the Transparency slider in Properties > Object data > Empty:



Note that when using transparent image empties, they will not be correctly drawn when they are not selected if Transparency is unchecked in Properties > Object > Display: