6. The method of claim 5 , further comprising a conversion of buffers into nodes and subsequently appending those nodes to the token stream.
6. The method of claim 5 , further comprising a conversion of buffers into nodes and subsequently appending those nodes to the token stream. 7. The method of claim 6 , further comprising inserting remaining buffers that did not activate finite state machine states into the token stream as token stream nodes.