4. A computer readable medium for storing data for access by an application program being executed on a data processing apparatus, comprising: a language model of text including a trie representation of the language model, the language model including a collection of n-grams from a corpus, each n-gram having a corresponding probability of occurring in the corpus, the language model represented as a trie structure assigning distinct values identifying each distinct n-gram of the collection, the trie structure constructed using vectors generated using the collection of n-grams; and where the trie structure is constructed using a left word vector and a diversity count vector, the left word vector identifying each distinct left word for a given right context in the collection, the diversity count vector identifying a count of distinct left words for each right context in the collection.
4. A computer readable medium for storing data for access by an application program being executed on a data processing apparatus, comprising: a language model of text including a trie representation of the language model, the language model including a collection of n-grams from a corpus, each n-gram having a corresponding probability of occurring in the corpus, the language model represented as a trie structure assigning distinct values identifying each distinct n-gram of the collection, the trie structure constructed using vectors generated using the collection of n-grams; and where the trie structure is constructed using a left word vector and a diversity count vector, the left word vector identifying each distinct left word for a given right context in the collection, the diversity count vector identifying a count of distinct left words for each right context in the collection. 5. The computer readable medium of claim 4 , where the language model is stored as a number of shards on a plurality of distributed machines, the content of each shard determined according to a sharding function and a corresponding distribution function applied to the language model.