1. A computer-implemented method comprising: receiving a first audio data corresponding to a first user utterance; obtaining, by a first speech recognizer, a transcription of the first user utterance and a speech recognition confidence value associated with the transcription of the first user utterance; based on determining that the speech recognition confidence value fails to meet a threshold value, transmitting the first audio data to a server-based speech recognizer; receiving, from a server, several search results associated with a second transcription of the first audio data, the second transcription of the first audio data being generated by the server-based speech recognizer; presenting one or more of the search results to a user; receiving a user selection of a particular search result from among the several search results; and storing the transcription of the first user utterance in association with the data identifying the particular search result.