8. A computer method for tokenizing a non-word-based document into a collection of tokens, comprising the computer executed steps of: (a) dividing said non-word-based document into a plurality of elements of same type; (b) providing a plurality of non-word-based token patterns wherein said plurality of non-word-based token patterns are pre-defined and not derived from said non-word-based document; (c) matching each of said plurality of elements of same type against each of said plurality of pre-defined non-word-based token patterns so as to generate a token for each match between an element and a pre-defined non-word-based token pattern, and providing a word-based name for each token; and (d) collecting all of said tokens in a collection of tokens, said collection of tokens is a word-based representation of said non-word-based document.
8. A computer method for tokenizing a non-word-based document into a collection of tokens, comprising the computer executed steps of: (a) dividing said non-word-based document into a plurality of elements of same type; (b) providing a plurality of non-word-based token patterns wherein said plurality of non-word-based token patterns are pre-defined and not derived from said non-word-based document; (c) matching each of said plurality of elements of same type against each of said plurality of pre-defined non-word-based token patterns so as to generate a token for each match between an element and a pre-defined non-word-based token pattern, and providing a word-based name for each token; and (d) collecting all of said tokens in a collection of tokens, said collection of tokens is a word-based representation of said non-word-based document. 10. The method of claim 8 wherein said non-word-based document is on the Internet.