2. The method of claim 1 , wherein the step of receiving text is comprised of the step of receiving text written predominantly in a first language, but containing textual units of a second language.
3. The method of claim 2 , wherein the step of determining in the selected token each user-definable textual-unit prefix, each user-definable textual-unit root, each user-definable textual-unit suffix, each user-definable disqualified textual-unit, and what is the token's length is comprised of the step of determining in the selected token each user-definable textual-unit prefix in a second language, each user-definable textual-unit root in a second language, each user-definable textual-unit suffix in a second language, each user definable disqualified textual-unit in the first language, and a length of the selected token, where the user-definable disqualified textual-unit includes a dictionary word in the first language and a user-definable stop-list word in the first language.