1. One or more computer-readable storage media having computer-executable instructions, wherein the computer-readable storage is not a signal, the computer-executable instructions, when executed performing steps comprising: receiving acoustic data having been captured from a speaker speaking; recognizing the acoustic data as a result and associated potential grapheme sequence; receiving input inputted by the speaker, the input indicating whether the speaker confirms that the result correctly applies to the acoustic data, and when the input confirms the result, associating the acoustic data with an actual grapheme sequence corresponding to the potential grapheme sequence, and when the input does not confirm the result, further interacting with the speaker until another result is confirmed as correctly applying to the acoustic data and associating the corresponding grapheme sequence as the actual grapheme sequence; and using the acoustic data and associated actual grapheme sequence for subsequent speech recognition, wherein the using the acoustic data and associated grapheme sequence for subsequent speech recognition comprises retraining a model that maps between grapheme sequences and phoneme sequences based on the acoustic data and associated grapheme.