1. A method of annotating an image, comprising: scoring the image using a plurality of trained classifiers, wherein each of the trained classifiers corresponds to at least one of a plurality of image groups clustered based upon image similarity, and wherein each image group is associated with a set of weighted labels, wherein each of the weighted labels includes a label and an associated weight, and wherein the associated weight is determined based upon the frequency of occurrence of the label in the image group; selecting one or more of the image groups based upon the scoring; aggregating one or more sets of weighted labels associated with the selected one or more image groups; and annotating the image using the aggregated one or more sets of weighted labels.