10. A software pipeline for generating a state estimate for a given frame of captured image data, the state estimate representing an estimate of a position of a user within a field of view captured within the image data, comprising: one or more experts for receiving information including one or more body part proposals and generating a plurality of computer models, each computer model representing an estimation of the position of the user in the given frame of captured image data at least one of the experts generating skeletal hypotheses from at least one of a tree structure of a human body including a torso and limbs as branches, a head triangle including a triangle formed by a head and shoulders and a torso volume including a torso; and an arbiter for receiving the plurality of computer models, scoring the computer models by one or more methodologies, and outputting at least one computer model estimated by the arbiter to best approximate the position of the user in the frame.
10. A software pipeline for generating a state estimate for a given frame of captured image data, the state estimate representing an estimate of a position of a user within a field of view captured within the image data, comprising: one or more experts for receiving information including one or more body part proposals and generating a plurality of computer models, each computer model representing an estimation of the position of the user in the given frame of captured image data at least one of the experts generating skeletal hypotheses from at least one of a tree structure of a human body including a torso and limbs as branches, a head triangle including a triangle formed by a head and shoulders and a torso volume including a torso; and an arbiter for receiving the plurality of computer models, scoring the computer models by one or more methodologies, and outputting at least one computer model estimated by the arbiter to best approximate the position of the user in the frame. 13. A software pipeline as recited in claim 10 , the arbiter further including an explained space methodology for scoring each of the plurality of computer models by examining how well the computer model explains all of the depth data in the foreground.