1. A method comprising: capturing, by a head mounted viewing device, an image of a local environment; identifying, based on an analysis of the image of the local environment, a first physical object and a second physical object located in the local environment; determining, based on the analysis of the image, a location and physical size of the first physical object and a location and a physical size of the second physical object; generating, based on the location and the physical size of the first physical object in the local environment and the location and the physical size of the second physical object in the local environment, a physical layout of the local environment, the physical layout of the local environment defining a relative position of the first physical object and the second physical object within the local environment and the physical size of the first physical object and the physical size of the second physical object; comparing the physical layout of the local environment to a set of saved physical layouts stored in a memory of the viewing device, yielding a comparison, each saved physical layout defining relative positions and physical sizes of physical objects located in a respective local environment corresponding to the saved physical layout; determining, based on the comparison, that the physical layout of the local environment matches a first saved physical layout; retrieving a virtual object corresponding to the first saved physical layout; displaying the virtual object on a display of the head mounted viewing device; detecting that a new physical object has been added to the local environment; adjusting a position of the virtual object on the display in response to detecting the new physical object.