1. An augmented reality system, comprising: a passable world model comprising a set of map points corresponding to one or more objects of the real world; and a processor to communicate with one or more individual augmented reality display systems to pass a piece of the passable world to the one or more individual augmented reality display systems, wherein the piece of the passable world is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.