1. A method of tokenizing a document having at least one character, the method comprising: assigning the at least one character to at least one of a plurality of character classes; and concurrently performing a plurality of comparisons wherein executing at least one of the plurality of comparisons comprises comparing the at least one of the plurality of character classes with an operand.