1. A computer-implemented method, comprising: accessing audio data; accessing information that indicates a first context, the first context being associated with the audio data; accessing at least one term; accessing information that indicates a second context, the second context being associated with the term; determining a similarity score that indicates a degree of similarity between the second context and the first context; adjusting a language model based on the accessed term and the determined similarity score to generate an adjusted language model, wherein the adjusted language model includes the accessed term and a weighting value assigned to the accessed term based on the similarity score, wherein the weighting value changes a probability for a transition between a first decision state in the language model and a second decision state in the language model; and performing speech recognition on the audio data using the adjusted language model to select one or more candidate transcriptions for a portion of the audio data.