1. A method comprising: training a language model by approximating large quantities of transcribed speech using a plurality of speaker dependent phonemic transcription based datasets that are based on pronunciation models obtained for each of a plurality of speakers; incorporating, in the language model, pronunciation probabilities associated with respective unique labels for each different pronunciation of a word, wherein the respective unique labels for most frequent words and most frequent word pairs indicate a special status in the language model; removing, from a pronunciation dictionary, the pronunciation probabilities; applying, via a processor, an utterance to a recognizer with the language model to yield a recognition result; and presenting the recognition result for the utterance.