1. A method for performing segment-based disparity decomposition, comprising the steps of: generating a left image from one of a stereo pair of image capture devices; determining one or more segments present in the left image; generating a right image from the other of the stereo pair of image capture devices; shifting one of the left and right images by one pixel; subtracting the shifted image from the other of the left and right images to form a difference image; determining a temporal stability associated with each of the one or more segments; determining a disparity value only for the one or more segments having been determined as temporally unstable in accordance with the difference image; and updating the portions of a disparity map corresponding to the determined disparity value for the one or more temporally unstable segments.