25. The method of claim 24 , wherein the annotator metadata includes a measure of the competence of the annotator.
24. The method of claim 17 , further comprising updating annotator metadata for at least one annotator using the received annotations, the source data metadata, and the distributed data annotation server system.