3. The method of claim 2 , the identification of one weight in the first plurality of weights for one token in the first plurality of tokens further comprising: identifying a first number of occurrences of the one token in the text corpus in a location that is proximate to the non-standard token; identifying a total number of occurrences of the one token in the text corpus; identifying a number of messages in the text corpus that include at least one occurrence of the one token; and identifying the one weight in the first plurality of weights for the one token in the first plurality of tokens with reference to a product of a ratio of the first number of occurrences of the one token to the total number of occurrences of the first token multiplied by a logarithm of a ratio of a predetermined total number of messages in the text corpus to the identified number of messages in the text corpus that include the at least one occurrence of the one token.
2. The method of claim 1 , the identification of the contextual similarity further comprising: identifying a first weight vector including a first plurality of weights with each weight in the first plurality of weights being an identified weight for one token in the first plurality of tokens; identifying a second weight vector including a second plurality of weights with each weight in the second plurality of weights being an identified weight for one token in the second plurality of tokens; identifying a sum of products of the first plurality of weights in the first weight vector multiplied by corresponding weights in the second plurality of weights in the second weight vector; identifying a first square root of a sum of squared values of the first plurality of weights in the first weight vector; identifying a second square root of a sum of squared values of the second plurality of weights in the second weight vector; and identifying the contextual similarity with reference to the identified sum divided by a product of the first square root multiplied by the second square root.