3. The computer-implemented method of claim 2 , comprising: during a first iteration on a first part, building the incremental language model from the original transcription corresponding to the first part; and during a subsequent iteration on a subsequent part, building L incremental language models, where M/L is less than or equal to one, and where each of the L incremental language models uses a portion of M/L duration of the original transcription corresponding to the subsequent part.
2. The computer-implemented method of claim 1 , comprising: dividing training data comprising audio data and transcription data corresponding to the audio data into N parts of M duration, wherein each part includes one or more utterances each comprising a plurality of words, and wherein N and M are positive integers; and g. iterating 1.a. through 1.f. for each utterance in one of the N parts; and h. iterating 2.g. for each of the N parts.