25. The method of claim 24 , wherein the positional information includes complete word, word-initial, word-final, and word-internal indications.
24. The method of claim 18 , wherein the associated information includes positional information of the character string within a token.