11. The system of claim 10 , wherein the must-split sub-dictionary contains split candidates with a confidence score above a predetermined high threshold, the must-join sub-dictionary contains join candidates with a confidence score above a second predetermined high threshold, and the normal sub-dictionary contains all other split, join, hyphen, and apostrophe candidates.
11. The system of claim 10 , wherein the must-split sub-dictionary contains split candidates with a confidence score above a predetermined high threshold, the must-join sub-dictionary contains join candidates with a confidence score above a second predetermined high threshold, and the normal sub-dictionary contains all other split, join, hyphen, and apostrophe candidates. 12. The system of claim 11 , wherein the reformulator is operable to compare the generated candidates of the query with the candidates in the three sub-dictionaries, and automatically submit to the search engine the generated candidates that are found in either the must-split or the must-join sub-dictionaries; and the language modeler is operable to apply the language model to the generated candidates that are found in the normal sub-dictionary.