1. A method, comprising: generating, by one or more computing devices, a set of inter-image homographies for an image sequence comprising a plurality of frames, said generating comprising: determining a plurality of point trajectories that traverse an initial frame pair; determining a subset of the plurality of point trajectories that traverse the initial frame pair, the subset of the plurality of point trajectories that traverse the initial frame pair corresponding to points defining a two-dimensional (2D) plane; estimating an inter-image homography for the initial frame pair according to the subset of the plurality of point trajectories that traverse the initial frame pair; and for each of one or more subsequent frame pairs, perform operations comprising: adding one or more inlier points whose trajectories correspond to trajectories of a subset of points tracked through a previous frame pair to create a plurality of point trajectories that traverse a current frame pair, the plurality of point trajectories that traverse the current frame pair corresponding to points defining the plane; determining a new subset of points tracked through the current frame pair from the plurality of point trajectories that traverse the current frame pair; and estimating an inter-image homography for the subsequent frame pair according to trajectories of the new subset of points tracked through the subsequent frame pair.