13. A apparatus for extracting meaning from multimodal inputs comprising: means for receiving a multimodal input; means for relating a first portion of the multimodal input comprising a first mode to a second portion of the multimodal input comprising a second mode, based on a first finite-state transducer; and means for generating a second finite-state transducer, the second finite-state transducer comprising a gesture and speech recognition model finite-state transducer, based on a first mode recognition lattice and the first finite-state transducer.
13. A apparatus for extracting meaning from multimodal inputs comprising: means for receiving a multimodal input; means for relating a first portion of the multimodal input comprising a first mode to a second portion of the multimodal input comprising a second mode, based on a first finite-state transducer; and means for generating a second finite-state transducer, the second finite-state transducer comprising a gesture and speech recognition model finite-state transducer, based on a first mode recognition lattice and the first finite-state transducer. 14. The apparatus of claim 13 further comprising: means for generating the first mode recognition lattice and the first finite-state transducer, based on the first mode.