1. In a computing environment, a method performed at least in part on at least one processor, the method comprising: receiving sets of input data corresponding to a plurality of input modalities, the received sets of input data including a first set of input data and a second set of input data, the first set of input data being associated with a first input modality from the plurality of input modalities, the second set of input data being associated with a second input modality from the plurality of input modalities, the first input modality being a speech or text input modality and the second input modality being a gesture input modality; selecting the first set of input data and the second set of input data; identifying, within a dictionary, speech or text input for the first set of input data and a gesture for the second set of input data to determine a meaning of a combination of the first and second set of input data; and providing output data for input by a program, the output data corresponding to the meaning of the first and second set of input data.
1. In a computing environment, a method performed at least in part on at least one processor, the method comprising: receiving sets of input data corresponding to a plurality of input modalities, the received sets of input data including a first set of input data and a second set of input data, the first set of input data being associated with a first input modality from the plurality of input modalities, the second set of input data being associated with a second input modality from the plurality of input modalities, the first input modality being a speech or text input modality and the second input modality being a gesture input modality; selecting the first set of input data and the second set of input data; identifying, within a dictionary, speech or text input for the first set of input data and a gesture for the second set of input data to determine a meaning of a combination of the first and second set of input data; and providing output data for input by a program, the output data corresponding to the meaning of the first and second set of input data. 4. The method of claim 1 wherein accessing a dictionary to determine a meaning of the first and second set of input data comprises accessing a dictionary to determine a combined meaning of the first and second set of input data.