1. A method performed by one or more computers, the method comprising: receiving data indicating multiple speech recognition hypotheses for an utterance; identifying multiple alternates for a particular word in a transcription of the utterance, wherein identifying the multiple alternates for the particular word of the transcription of the utterance comprises: determining a time that the particular word begins or ends with respect to the utterance; accessing data indicating times that words in the multiple speech recognition hypotheses begin or end with respect to the utterance; and identifying the words in the multiple speech recognition hypotheses based on a measure indicative of a distance between (i) the time that the particular word begins or ends with respect to the utterance and (ii) the times that the words in the multiple speech recognition hypotheses begin or end with respect to the utterance; for each of the identified alternates: determining one or more feature scores for the alternate; inputting the one or more feature scores to a trained classifier; and receiving an output from the classifier; selecting a subset of the identified alternates to provide for display based on the classifier outputs; and providing, for display, data indicating the selected subset of the alternates.
2. The method of claim 1 , wherein receiving data indicating multiple speech recognition hypotheses for the utterance comprises receiving data indicating a speech recognition lattice.