1. A computer-implemented method for a video surveillance system to process a sequence of video frames depicting a scene captured by a video camera, comprising: receiving a request to view an object classification type assigned to a foreground object depicted in the sequence of video frames, wherein the object classification type classifies the foreground object as being an instance of one of a plurality of foreground object classification types, and wherein the object classification type is assigned to the foreground object based on a plurality of micro-features derived from analyzing pixels depicting the foreground object in the sequence of video frames; generating a visual representation of the requested object classification type; and outputting the generated visual representation for display.