7. The method of claim 5 wherein the token delimiter indicator comprises a value of a first character of the relevant token and the length of the relevant token.
7. The method of claim 5 wherein the token delimiter indicator comprises a value of a first character of the relevant token and the length of the relevant token. 8. The method of claim 7 further comprising: maintaining all token delimiter indicators as an index with an index key being a value of a first character.