1. A computer-implemented method comprising: receiving an audio signal encoding a portion of an utterance; receiving context information associated with the utterance, wherein the context information is not derived from the audio signal or any other audio signal; providing, as input to a neural network, data corresponding to the audio signal and the context information; and generating a transcription for the utterance based on at least an output of the neural network.