17. A computer-readable storage device bearing computer-executable instructions that, when executed on a computer, cause the computer to perform operations comprising: receiving data representative of a user in a physical space; processing the received data to identify a first motion or pose by the user that invokes an input command to the computer; correlating the first motion or pose to a first gesture dictionary of a plurality of gesture dictionaries, each gesture dictionary of the plurality of gesture dictionaries comprising a set of input commands to the computer that may be invoked by motions or poses of the user reflected in the received data; and assigning the first gesture dictionary to the user, the first gesture dictionary corresponding to the first motion or pose; and processing additional captured data with the first gesture dictionary to identify whether a second motion or pose by the user in the additional captured data invokes an input command to the computer.
21. The computer-readable storage device of claim 17 , wherein correlating the first motion or pose to the first gesture dictionary comprises: determining a skill level of the user; and correlating the first motion or pose and the skill level of the user to the first gesture dictionary of a plurality of gesture dictionaries.