19. A computer program product, tangibly stored on a non-transitory computer-readable medium, comprising instructions operable to cause a programmable processor to: receiving a plurality of tokens, the plurality of tokens comprising a first n-gram, and the first n-gram being composed of a first number of atomic units; and segmenting the plurality of tokens into one or more words based at least in part on a scaled probability of the first n-gram identifying a word, the scaled probability being determined by adjusting an initial probability of the n-gram identifying a word based at least in part on the first number of atomic units.
19. A computer program product, tangibly stored on a non-transitory computer-readable medium, comprising instructions operable to cause a programmable processor to: receiving a plurality of tokens, the plurality of tokens comprising a first n-gram, and the first n-gram being composed of a first number of atomic units; and segmenting the plurality of tokens into one or more words based at least in part on a scaled probability of the first n-gram identifying a word, the scaled probability being determined by adjusting an initial probability of the n-gram identifying a word based at least in part on the first number of atomic units. 25. The computer program product of claim 19 , the operations further comprising: identifying lesser order n-grams, the lesser order n-grams being derived from the first n-gram; and identifying a respective scaled probability of each of the lesser order n-grams identifying a word, the scaled probability for a particular lesser order n-gram composed of a particular number of atomic units identifying a word being determined by adjusting an initial probability of the lesser order n-gram identifying a word based at least in part on the particular number of atomic units.