1. A multimodal system for receiving inputs via more than one mode from a user and for interpretation and display of text based upon the inputs received via the more than one modes, the system comprising: a) a user input device having a plurality of modes, one mode accepting speech input and the remaining modes accepting entry of non-speech input; b) a memory containing a plurality of acoustic networks, each of the plurality of acoustic networks being associated with at least one mode; and c) a processor to: i) process the speech input and at least one non-speech input accepted by at least one of the remaining modes; ii) dynamically adapting an acoustic network based on the speech input and the at least one non-speech input; iii) perform automatic speech recognition using the dynamically adapted acoustic network; iv) determine an output based on the automatic speech recognition; and v) return the output to aid in a determination of a subsequent user-action.