1. A system for decoupling applications in multi-computer interactive configuration, the system comprising: a display system processor that is communicatively coupled to a plurality of sensors and a display system that includes a plurality of display devices; a first remote client device; and a second remote client device, wherein the first remote client device generates a first un-typed data structure that includes first typed graphics data of a first client application of the first remote client device, and provides the first un-typed data structure to the display system processor, wherein the second remote client device generates a second un-typed data structure that includes second typed graphics data of a second client application of the second remote client device, and provides the second un-typed data structure to the display system processor, wherein the display system processor includes the first un-typed data structure and the second un-typed data structure in a first pool of the display system processor, wherein the display system processor renders graphics data of the first pool and controls at least one of the display system, the first remote client device and the second remote client device to display the rendered graphics data of the first pool, the rendered graphics data of the first pool including rendered graphics data for the first typed graphics data and rendered graphics data for the second typed graphics data, wherein the display system processor simultaneously detects a first gesture of a first object associated with the first remote client device and a second gesture of a second object associated with the second remote client device from gesture data received via the plurality of sensors, wherein the gesture data includes absolute three-space location data of an instantaneous state of the first object and the second object at a point in time and space, wherein the display system processor controls at least one of the display system, the first remote client device, and the second remote client device to update the display of the rendered graphics data for the first typed graphics data based on the detected second gesture of the second object associated with the second remote client device, wherein the first un-typed data structure and the second un-typed data structure have a format that is application-independent, wherein the first client application is different from the second client application, and wherein the first un-typed data structure and the second un-typed data structure have a same format.