8. A computer-readable, hardware storage medium having instructions stored thereon for processing data information, such that the instructions, when carried out by a processing device, cause the processing device to perform operations of: analyzing a distribution of repeat occurrences of words in a word pool to train a class-based language model; creating the class-based language model to include multiple classes of words, the multiple classes including a first class of words and a second class of words; identifying a word present in the word pool; including the word in the first class of words; including the word in the second class of words; and depending on the distribution of the repeat occurrences of the words in the word pool, generating probability information associated with the multiple classes to create the class-based language model; wherein the word assigned to the first class is used in accordance with a first meaning in the word pool, the first class of words including a first set of words from the word pool that are commonly used together in a first context; wherein the word assigned to the second class is used in accordance with a second meaning in the word pool, the second meaning different than the first meaning, the second class of words including a second set of words from the word pool that are commonly used together in a second context; the computer-readable storage medium further including instructions stored thereon that causes the processing device to perform operations of: receiving a sample sequence of words; and utilizing the class-based language model to identify an overall probability value indicative of how likely an instance of the word follows the sample sequence of words, the overall probability value generated based on a likelihood that an instance of the word follows an instance of the sample sequence of words in the word pool; in response to detecting that there is no occurrence in which the common word in the first class follows the sample sequence in the word pool: i) producing a modified sample sequence by removing a at least one word from the sample sequence: ii) generating a first probability value based at least in part on a probability that the common word in the first class follows an occurrence of the modified sample sequence in the word pool; in response to detecting that there is at least one occurrence in which the common word in the second class follows the sample sequence in the word pool, generating a second probability value based at least in part on a number of occurrences in which the word in the second class follows an occurrence of the sample sequence in the word pool; and summing the first probability value and the second probability value to produce the overall probability value.
8. A computer-readable, hardware storage medium having instructions stored thereon for processing data information, such that the instructions, when carried out by a processing device, cause the processing device to perform operations of: analyzing a distribution of repeat occurrences of words in a word pool to train a class-based language model; creating the class-based language model to include multiple classes of words, the multiple classes including a first class of words and a second class of words; identifying a word present in the word pool; including the word in the first class of words; including the word in the second class of words; and depending on the distribution of the repeat occurrences of the words in the word pool, generating probability information associated with the multiple classes to create the class-based language model; wherein the word assigned to the first class is used in accordance with a first meaning in the word pool, the first class of words including a first set of words from the word pool that are commonly used together in a first context; wherein the word assigned to the second class is used in accordance with a second meaning in the word pool, the second meaning different than the first meaning, the second class of words including a second set of words from the word pool that are commonly used together in a second context; the computer-readable storage medium further including instructions stored thereon that causes the processing device to perform operations of: receiving a sample sequence of words; and utilizing the class-based language model to identify an overall probability value indicative of how likely an instance of the word follows the sample sequence of words, the overall probability value generated based on a likelihood that an instance of the word follows an instance of the sample sequence of words in the word pool; in response to detecting that there is no occurrence in which the common word in the first class follows the sample sequence in the word pool: i) producing a modified sample sequence by removing a at least one word from the sample sequence: ii) generating a first probability value based at least in part on a probability that the common word in the first class follows an occurrence of the modified sample sequence in the word pool; in response to detecting that there is at least one occurrence in which the common word in the second class follows the sample sequence in the word pool, generating a second probability value based at least in part on a number of occurrences in which the word in the second class follows an occurrence of the sample sequence in the word pool; and summing the first probability value and the second probability value to produce the overall probability value. 12. The computer-readable storage medium as in claim 8 further including instructions stored thereon that causes the processing device to perform operations of: utilizing the class-based language model to generate a probability value indicative of a likelihood of a word following a sequence of words, the probability value based on a first probability that an instance of the word in the first class follows an instance of the sequence of words in the word pool and a second probability that an instance of the word in the second class follows an instance of the sequence of words in the word pool.