1. A method of video segmentation, for differentiating between foreground and background portions of video, comprising the steps of: obtaining a frame sequence from a real-time video stream; and for two or more frames in the frame sequence, performing the following steps: labeling pixels in the frames; performing spatial or temporal filtering; updating a background statistical model, after the pixels are labeled; and at least one of building or updating at least one foreground statistical model, after the pixels are labeled.