14. A software pipeline as recited in claim 10 , the arbiter further including a static joint configuration scoring methodology for scoring each of the plurality of computer models by examining whether the computer models have lengths and angles between joints which conform to lengths and angles that are possible for body parts of a human body.
10. A software pipeline for generating a state estimate for a given frame of captured image data, the state estimate representing an estimate of a position of a user within a field of view captured within the image data, comprising: a preprocessing routine for receiving the image data, removing a background from the image data, and processing a foreground into one or more body part proposals; one or more experts for receiving information including the one or more body part proposals and generating a plurality of computer models, each computer model representing an estimation of the position of the user in the given frame of captured image data; and an arbiter for receiving the plurality of computer models, scoring the computer models by one or more methodologies which compare the plurality of computer models against depth data from the given frame and/or state estimate data from a prior frame, and outputting at least one computer model estimated by the arbiter to best approximate the position of the user in the frame.