1. A method for processing a video sequence comprised of a plurality of frames, said method comprising the steps of: extracting a feature from each of said frames; determining correspondences between said extracted feature from said frames; estimating motion in said video sequence based on said determined correspondences; generating an image including majority of background pixels in said frames based on said estimated motion; and extracting foreground information from each of said frames based on said image.