1. A method comprising: receiving into a computer processor a first document and a second document, the second document comprising a count of words less than or equal to a count of words in the first document; generating using the computer processor a frequency distribution for the words in the first document and a frequency distribution for the words in the second document; determining with the computer processor an intersection of the first document and the second document, the intersection comprising a set of words that appear in both the first document and the second document; for each word in the intersection, comparing with the computer processor the frequency of the word in the first document with the frequency of the word in the second document; for each word in the intersection, selecting with the computer processor the lower frequency between the frequency of the word in the first document and the frequency of the word in the second document; and determining with the computer processor a similarity measure between the first document and the second document as a function of a count of the words in the intersection, a count of the words in the second document, the selected lower frequencies, and the frequency distribution for the words in the second document; wherein determining the similarity measure comprises: (a) computing a first ratio of the count of words in the intersection to the count of words in the second document, and multiplying the first ratio by a count weight; (b) computing a first sum of the lower frequencies, computing a second sum of the frequency distribution of the second document, computing a second ratio of the first sum to the second sum, and multiplying the second ratio by a word score weight; (c) computing a resultant sum of step (a) and step (b); and (d) dividing the resultant sum by a sum of the count weight and the word score weight.
1. A method comprising: receiving into a computer processor a first document and a second document, the second document comprising a count of words less than or equal to a count of words in the first document; generating using the computer processor a frequency distribution for the words in the first document and a frequency distribution for the words in the second document; determining with the computer processor an intersection of the first document and the second document, the intersection comprising a set of words that appear in both the first document and the second document; for each word in the intersection, comparing with the computer processor the frequency of the word in the first document with the frequency of the word in the second document; for each word in the intersection, selecting with the computer processor the lower frequency between the frequency of the word in the first document and the frequency of the word in the second document; and determining with the computer processor a similarity measure between the first document and the second document as a function of a count of the words in the intersection, a count of the words in the second document, the selected lower frequencies, and the frequency distribution for the words in the second document; wherein determining the similarity measure comprises: (a) computing a first ratio of the count of words in the intersection to the count of words in the second document, and multiplying the first ratio by a count weight; (b) computing a first sum of the lower frequencies, computing a second sum of the frequency distribution of the second document, computing a second ratio of the first sum to the second sum, and multiplying the second ratio by a word score weight; (c) computing a resultant sum of step (a) and step (b); and (d) dividing the resultant sum by a sum of the count weight and the word score weight. 6. The method of claim 1 , wherein the count weight is equal to one and the word score weight is equal to one.