1. A method for performing image based regression using boosting to infer an entity that is associated with an image of an object, the method comprising the steps of: learning a regression function for a plurality of images in which for each image the associated entity is known; and using the learned regression function to predict an entity associated with an image in which the entity is not known.