Stabilize a video using only one tracking piont
Use Tripod tracking instead and this will solve without 3D reconstruction. Also send the tracker to 2D Stabilization, it is located in the Movie Clip editor's Properties panel (n-key). Now you will have a motion vector based on a single tracker.