1. A method for tracking a user comprising: receiving information having a plurality of depth elements; generating a data structure based in part on the depth elements; using the data structure to make an estimation of a location or position of an extremity of the user; and adjusting a model based on the estimation.