7. The apparatus of claim 6 , wherein the sequence of instructions for the grammar inducer further comprise instructions configuring the processor to perform: forming a histogram of tokens according to the frequency of each token; and segmenting the text into records starting with tokens with lower frequency.
7. The apparatus of claim 6 , wherein the sequence of instructions for the grammar inducer further comprise instructions configuring the processor to perform: forming a histogram of tokens according to the frequency of each token; and segmenting the text into records starting with tokens with lower frequency. 8. The apparatus of claim 7 , wherein the sequence of instructions for the grammar inducer further comprise instructions configuring the processor to perform: recursively segmenting the records to identify the underlying hierarchical structure.