5. The method of claim 1 , further comprising determining that a pair of the documents are duplicates based on a comparison of the respective query-relevant parts of the pair of documents.
6. The method of claim 5 wherein the respective query-relevant parts of the pair of documents are identical.