1. A computer implemented method of tracking a face moving through multiple frames of a video sequence, the method comprising: obtaining a predicted position of a face in a video frame; performing a search to determine appearance model similarity values of detected face; obtaining motion and appearance probabilities of the detected face; and associating the face in the video frame with a track as a function of a joint probabilistic data association filter using a detection threshold that is reduced for a face appearing in the predicted position.