6. A method for recognizing an utterance comprising: receiving an utterance comprising a plurality of modes; relating a first portion of the utterance comprising a first mode of the plurality of modes to a second portion of the utterance comprising a second mode of the plurality of modes, based on a first finite-state transducer; generating a second finite-state transducer, comprising a gesture and speech recognition model finite-state transducer, based on a first mode recognition lattice and the first finite-state transducer; and outputting a recognition result based on the utterance and the second finite-state transducer.
7. The method of claim 6 further comprising: generating the first mode recognition lattice and the first finite-state transducer, based on the first mode.