1. A computer readable storage medium having a lexicon for storing word information and adapted for use with a text analyzer in a language processing system, wherein the lexicon is adapted to be used in a plurality of language processing tasks, the lexicon comprising: a word list section for storing a list of words; a set of data sections corresponding with each word on the word list, wherein the data sections store substantially different selected information about the corresponding word in the word list; and for each word on the word list, a plurality of pointers stored in an indices table apart from the sets of data sections, each of the pointers pointing to a different data section related to different information about the corresponding word, wherein the plurality of pointers comprises a first set and a second set of the pointers, the first set used to access information related to a first natural language processing task and the second set used to access information related to a second natural language processing task, wherein the first set of the pointers is not the same as the second set of the pointers.
1. A computer readable storage medium having a lexicon for storing word information and adapted for use with a text analyzer in a language processing system, wherein the lexicon is adapted to be used in a plurality of language processing tasks, the lexicon comprising: a word list section for storing a list of words; a set of data sections corresponding with each word on the word list, wherein the data sections store substantially different selected information about the corresponding word in the word list; and for each word on the word list, a plurality of pointers stored in an indices table apart from the sets of data sections, each of the pointers pointing to a different data section related to different information about the corresponding word, wherein the plurality of pointers comprises a first set and a second set of the pointers, the first set used to access information related to a first natural language processing task and the second set used to access information related to a second natural language processing task, wherein the first set of the pointers is not the same as the second set of the pointers. 2. The computer readable storage medium of claim 1 wherein the word list section comprises a Trie data structure.