1. A method for tracking a moving object in a sequence of frames acquired of a scene, each frame including a plurality of pixels, comprising for each frame the steps of: classifying the plurality of pixels with a strong classifier to generate a confidence map corresponding to the frame; applying a mean-shift operation to the confidence map to detect a peak, the peak corresponding to a location of the object in the frame; and updating the strong classifier, and in which the steps are performed using multiple resolutions, and in which there is one confidence map at each resolution, and in which the confidence maps at the multiple resolutions are averaged.