1. A method for using a natural input device to control a legacy gaming system, the method comprising: receiving a natural user input from the natural input device, the natural input device distinct from a legacy controller device of the legacy gaming system, the natural user input simulating a game motion that corresponds to a motion a legacy game input represents, wherein receiving the natural user input includes receiving a depth image from an image capture device including a depth camera; selecting a gesture library from a plurality of gesture libraries based on a legacy gaming program running on the legacy gaming system; associating the natural user input with a first gesture from the gesture library selected; mapping the associated first gesture to the corresponding input of the legacy controller device; sending the corresponding input to the legacy gaming system in response to receiving the natural user input; and adding a second gesture to a gesture library in the plurality of gesture libraries.
1. A method for using a natural input device to control a legacy gaming system, the method comprising: receiving a natural user input from the natural input device, the natural input device distinct from a legacy controller device of the legacy gaming system, the natural user input simulating a game motion that corresponds to a motion a legacy game input represents, wherein receiving the natural user input includes receiving a depth image from an image capture device including a depth camera; selecting a gesture library from a plurality of gesture libraries based on a legacy gaming program running on the legacy gaming system; associating the natural user input with a first gesture from the gesture library selected; mapping the associated first gesture to the corresponding input of the legacy controller device; sending the corresponding input to the legacy gaming system in response to receiving the natural user input; and adding a second gesture to a gesture library in the plurality of gesture libraries. 3. The method of claim 1 , wherein the depth image includes depth values for objects in a field of view of the depth camera, the method further comprising processing the depth image to identify the natural user input.