1. A computer-implemented method, comprising: receiving, at a server system, audio data that includes encoded speech, the encoded speech having been detected by a client device; receiving, at the server system, information that indicates a docking context of the client device while the speech encoded in the audio data was detected by the client device; identifying a plurality of language models, each of the plurality of language models indicating a probability of an occurrence of a term in a sequence of terms based on other terms in the sequence; for each of the plurality of language models, determining a weighting value to assign to the language model based on the docking context by accessing a stored weighting value associated with the docking context, the weighting value indicating a probability that using the language model will generate a correct transcription of the encoded speech; selecting at least one of the plurality of language models based on the assigned weighting values; and performing speech recognition on the audio data using the selected language model to identify a transcription for a portion of the audio data.