17. The method according to claim 16 , further comprising: removing duplicate or near-duplicate communications from the identified subset based on the similarity scores.
17. The method according to claim 16 , further comprising: removing duplicate or near-duplicate communications from the identified subset based on the similarity scores. 18. The method according to claim 17 , wherein the removing is performed before computing the diversity scores.