1. A method for encoding multiple view video streams, the method comprising the steps of: identifying a first plurality of identified image segments within a first plurality of images, the first plurality of images having been captured at substantially a first time and capturing a first at least partially common view of a first scene, at least two of the images within the first plurality of images each comprising at least one image segment in the first set of corresponding image segments; creating a first graph data structure comprising a first plurality of nodes with each of the nodes in the first plurality of nodes being associated with a respective set of corresponding image segments within the at least one first set of corresponding image segments; and specifying at least one link between two of the nodes within the first graph data structure based upon a relationship between the two identified image segments that are associated with the two nodes within the first graph data structure.