1. A method for tracking a moving object in a sequence of frames acquired of a scene, each frame including a plurality of pixels, comprising for each frame the steps of: classifying the plurality of pixels with a strong classifier to generate a confidence map corresponding to the frame; applying a mean-shift operation to the confidence map to detect a peak, the peak corresponding to a location of the object in the frame; and updating the strong classifier.