1. A system for computing optical flow between images within an image sequence comprising: an image processor processing the image sequence, wherein the image processor: derives epipolar geometry for the images from point matches between the images; and computes optical flow for each pixel within at least one of the images under a constraint derived from the epipolar geometry.