1. A method for video object segmentation, comprising: aligning one or more reference frames with a current frame containing a video object; generating a foreground mask for a current frame based on a neighborhood similarity metric; and refining the foreground mask by using information from at least one video frame or mask.