8. The distributed data annotation server system of claim 1 , wherein the distributed data annotation application further configures the processor to update annotator metadata for at least one annotator using the received annotations and the source data metadata.
8. The distributed data annotation server system of claim 1 , wherein the distributed data annotation application further configures the processor to update annotator metadata for at least one annotator using the received annotations and the source data metadata. 9. The distributed data annotation server system of claim 8 , wherein the annotator metadata includes a measure of the competence of the annotator