7. A text pattern matching system as defined in claim 6 in which each text token and each query token further includes a symbol identifier, the symbol identifier in each text token having a value that identifies the text symbol associated therewith and the symbol identifier in each query token having a value that identifies the query symbol associated therewith, the match token generator control module enabling the processor to identify, for each query token in said memory, ones of said text tokens in said memory having symbol identifiers which correspond to the query token's symbol identifier, and to generate a match token for each text token so identified.
8. A text pattern matching system as defined in claim 7 in which the match token generator control module includes: A. a token sorter control module for enabling said processor to perform a sort operation to place the text tokens and the query tokens storage locations in said memory in sorted order according to the values of their respective text symbols and query symbols, so that each query token will be located in a storage location proximate storage locations containing said text tokens whose text symbols correspond to the query token's query symbol; B. a proximate token identifier control module for enabling the processor to, for each query token, identify the text tokens whose text symbol corresponds to the value of the query token's query symbol, in that operation the processor, for each query token, comparing the query token's query symbol to proximate text tokens in the sorted order as generated during processing in response to the token sorter control module and identifying those text tokens whose text symbols correspond to the query token's query symbol; and B. a token generator control module for enabling the processor to generate a match token for each text token identified during processing in response to said proximate token identifier control module.