1. A computerized method for tracking an object in a sequence of frames, comprising the steps of: extracting a feature frame from each frame in a sequence of frames acquired of an object; constructing a set of feature vectors for each feature frame, each feature vector corresponding to a different window of features in the feature frame; determining a corresponding set of covariance matrices from the set feature vectors; measuring distances between each covariance matrix in the set of covariance matrices and a model covariance matrix representing the object; and selecting a particular window as a location of the object in the frame, the particular window having a corresponding covariance matrix with a minimum distance from the model covariance matrix.