1. A computer-readable storage device having stored thereon computer executable instructions for processing depth information of a scene, the computer executable instructions comprising instructions for: receiving a depth image of the scene, wherein the depth image comprises one or more objects; determining that at least one object of the one or more objects in the depth image is moving, wherein determining that the at least one object of the one or more objects in the depth image is moving comprises: comparing a value associated with each voxel in the one or more objects with a corresponding value of a reference voxel included in a reference plate; identifying each voxel in the one or more objects as moving when a difference between the value and the corresponding value exceeds a motion threshold; calculating a foreground score based on a percentage of moving voxels associated with the at least one object; and identifying the at least one object as moving when the foreground score exceeds a score threshold; isolating the at least one object that is moving; and processing the at least one isolated object.