1. A method for generating a model of a user's hand including one or more fingers, comprising: (a) receiving position data representing a position of a user interacting with a sensor, the position data including at least one of depth and image data representing the user's hand; and (b) analyzing the position data to identify the user's hand in the position data, said step (b) including the steps of: (b)( 1 ) analyzing depth data from the position data captured in said step (a) to segment the position data into data of the hand, and (b)( 2 ) extracting a set of feature descriptors by applying one or more filters to the image data of the hand identified in said step (b)(1), the one or more filters analyzing image data of the hand as compared to image data outside of a boundary of the hand to discern features of the hand including a shape and orientation of the hand.