1. A computer-implemented method of generating a display of information learned by a video surveillance system, comprising: receiving a request to view a trajectory map for a scene depicted in a sequence of video frames captured by a video camera; retrieving a background image associated with the scene; retrieving one or more trajectories associated with one or more foreground objects depicted in the sequence of video frames, wherein each trajectory plots a path traversed by a respective foreground object in moving through the scene; and superimposing a visual representation of each retrieved trajectory over the background image at a location corresponding to the path traversed by the respective foreground object in moving through the scene.