1. A computer-implemented method of indexing text in multiple language types with synonyms in each language type, comprising: receiving information to be indexed in at least one language type; removing spaces between characters and segmenting the information to be indexed into at least one token; determining, using at least one processor of at least one computing device, a language type for each token; analyzing, using the at least one processor of the at least one computing device, a language dictionary for the determined language type of each token and further segmenting the information into at least one additional token when contents of the token correspond to separate entries in the language dictionary; searching for synonyms of the multiple language types corresponding to the contents of each token after analyzing the language dictionary for each token; using the at least one processor of the at least one computing device, removing punctuation from each token and further segmenting the information into at least one additional token where punctuation is removed; and storing the synonyms and contents of each token for use in indexing the information.
1. A computer-implemented method of indexing text in multiple language types with synonyms in each language type, comprising: receiving information to be indexed in at least one language type; removing spaces between characters and segmenting the information to be indexed into at least one token; determining, using at least one processor of at least one computing device, a language type for each token; analyzing, using the at least one processor of the at least one computing device, a language dictionary for the determined language type of each token and further segmenting the information into at least one additional token when contents of the token correspond to separate entries in the language dictionary; searching for synonyms of the multiple language types corresponding to the contents of each token after analyzing the language dictionary for each token; using the at least one processor of the at least one computing device, removing punctuation from each token and further segmenting the information into at least one additional token where punctuation is removed; and storing the synonyms and contents of each token for use in indexing the information. 3. A method according to claim 1 , further comprising: determining for each token whether to perform a one way or a two way test for synonyms.