2. A system that performs grammar learning from a corpus, the system comprising: a first module configured to control a processor to generate frequency vectors for each non-context token in a corpus based upon counted occurrences of a predetermined relationship of the non-context tokens to context tokens; a second module configured to control the processor to cluster the non-context tokens based upon the frequency vectors according to a lexical correlation among the non-context tokens; and a third module configured to control the processor to use a cluster tree for pattern recognition.
2. A system that performs grammar learning from a corpus, the system comprising: a first module configured to control a processor to generate frequency vectors for each non-context token in a corpus based upon counted occurrences of a predetermined relationship of the non-context tokens to context tokens; a second module configured to control the processor to cluster the non-context tokens based upon the frequency vectors according to a lexical correlation among the non-context tokens; and a third module configured to control the processor to use a cluster tree for pattern recognition. 7. The system of claim 2 , wherein the predetermined relationship is a measure of adjacency.