1. A method comprising: identifying, by an image manipulation application executed by a processing device, a plurality of image pairs from an input image, wherein each of the plurality of image pairs comprises an image portion from a first perspective and the image portion from a second perspective; generating, by the image manipulation application, a plurality of displacement vectors for the plurality of image pairs, wherein each of the plurality of displacement vectors represents at least one of a horizontal displacement and a vertical displacement of the image portion from the first perspective to the second perspective; generating, by the image manipulation application, a plurality of normalized displacement vectors corresponding to the plurality of displacement vectors, wherein each of the plurality of normalized displacement vectors is generated by transforming a respective orientation of a corresponding one of the plurality of displacement vectors to a common reference direction; assigning a respective confidence level to each of the plurality of normalized displacement vectors; and generating, by the image manipulation application, a depth map based on an average displacement vector that is determined from a weighted average of the plurality of normalized displacement vectors, wherein the weighted average is determined based on the confidence levels of the plurality of normalized displacement vectors.