1. A method comprising: receiving speech with a missing segment; generating, via a processor, a plurality of hypotheses for the missing segment based at least in part on an acoustic feature of the received speech; generating possible options for the missing segment, each possible option comprising the speech and a hypothesis of the plurality of hypotheses at a location of the missing segment; assigning a same acoustic score to each hypothesis of the plurality of hypotheses; and evaluating the possible options using the same acoustic score to identify a possible option that represents the speech.