1. A computer-implemented method of handling missing speech data, the method comprising: receiving speech with a missing segment; generating a plurality of hypotheses for the missing segment; identifying a best hypothesis for the missing segment; and recognizing the received speech by inserting the identified best hypothesis for the missing segment.