OpenCV camshift algorithm
According to SR who posted here http://answers.opencv.org/question/18311/why-use-hue-channel-of-hsv-for-mean-shift-tracking/ the H channel in HSV 


  "... is not influenced by the image brightness and saturation. You get the "pure" color disregarding the actual lighting (which might change over time)."