1. A system for generating a disparity map, comprising: a stereo camera for acquiring right and left images at a first time and corresponding right and left images at a second time; and a processor for defining one or more textured regions in one of the right and left images acquired at the first time, segmenting the one or more textured regions into their color primitives, determining a corresponding one or more segmented textured regions in the other of the right and left images acquired at the first time, calculating a disparity between the segmented textured regions in the first and second right and left images acquired at the first time in accordance with the segmented color primitives; generating a first disparity map based upon the calculated disparity, determining one or more objects that change position between one of the left and right images acquired at the first time and a corresponding one of the left and right images acquired at the second time by calculating a difference result, the difference result being calculated only for segments determined to be temporally unstable, such difference result being stored in a compressed format, generating disparity map update segments corresponding to the objects, and combining the first disparity map and the disparity map update segments.