1. A method comprising: identifying features in an image of a scene; determining a three-dimensional position for one or more features in the scene; analyzing the three-dimensional position of at least one feature in the scene to determine position information of a control object; causing display of a video display that includes at least a first virtual object and a second virtual object laid out at different depths, the first virtual object being defined by first three-dimensional bounds that describe a three-dimensional shape of the first virtual object and the second virtual object being defined by second three-dimensional bounds that describe a three-dimensional shape of the second virtual object; mapping the position information of the control object to three-dimensional coordinates relative to the video display including a depth coordinate relative to the video display; comparing the three-dimensional coordinates of the control object including the depth coordinate of the control object to the first three-dimensional bounds that define the first virtual object and the second three-dimensional bounds that define the second virtual object; based on comparison results, determining whether the three-dimensional coordinates of the control object are within the first three-dimensional bounds that define the first virtual object or the second three-dimensional bounds that define the second virtual object; based on a determination that the three-dimensional coordinates of the control object are within the first three-dimensional bounds that define the first virtual object, determining that the control object is interacting with the first virtual object and controlling an application based on the determination that control object is interacting with the first virtual object; and based on a determination that the three-dimensional coordinates of the control object are within the second three-dimensional bounds that define the second virtual object, determining that the control object is interacting with the second virtual object and controlling the application based on the determination that control object is interacting with the second virtual object, wherein determining whether the three-dimensional coordinates of the control object are within the first three-dimensional bounds that define the first virtual object or the second three-dimensional bounds that define the second virtual object comprises: determining that the three-dimensional coordinates of the control object are within the first three-dimensional bounds that define the first virtual object when the depth coordinate of the control object indicates that the control object is located at a first depth relative to the video display, and determining that the three-dimensional coordinates of the control object are within the second three-dimensional bounds that define the second virtual object when the depth coordinate of the control object indicates that the control object is located at a second depth relative to the video display, the second depth relative to the video display being different than the first depth relative to the video display.