7. The method of claim 6 , further comprising inserting remaining buffers that did not activate finite state machine states into the token stream as token stream nodes.
7. The method of claim 6 , further comprising inserting remaining buffers that did not activate finite state machine states into the token stream as token stream nodes. 8. The method of claim 7 , further comprising returning the token stream, comprised of token stream nodes.