4. The method of claim 1 , further comprising: determining a contextual relevance of an occurrence of the compound token in a portion of the corpus, wherein the weight is a function of the contextual relevance.
5. The method of claim 4 , wherein the contextual relevance comprises a grammatical correctness of the compound token in the portion of the corpus.