19. A computer program product, tangibly stored on a non-transitory computer-readable medium, comprising instructions operable to cause a programmable processor to: receiving a plurality of tokens, the plurality of tokens comprising a first n-gram, and the first n-gram being composed of a first number of atomic units; and segmenting the plurality of tokens into one or more words based at least in part on a scaled probability of the first n-gram identifying a word, the scaled probability being determined by adjusting an initial probability of the n-gram identifying a word based at least in part on the first number of atomic units.
19. A computer program product, tangibly stored on a non-transitory computer-readable medium, comprising instructions operable to cause a programmable processor to: receiving a plurality of tokens, the plurality of tokens comprising a first n-gram, and the first n-gram being composed of a first number of atomic units; and segmenting the plurality of tokens into one or more words based at least in part on a scaled probability of the first n-gram identifying a word, the scaled probability being determined by adjusting an initial probability of the n-gram identifying a word based at least in part on the first number of atomic units. 21. The computer program product of claim 19 , wherein adjusting the initial probability of the first n-gram identifying a word based at least in part on the first number of atomic units comprises: identifying a scaling weight depending on the first number of atomic units; and applying the scaling weight to the initial probability of the first n-gram identifying a word to determine the scaled probability of the first n-gram identifying a word.