1. In a computing environment, a method performed at least in part on at least one processor, comprising, detecting symbolic activity between at least two users of a given environment, including receiving sets of input data corresponding to one or more input modalities, processing a model associated with context-dependent grammar for the given environment, using the model to interpret the symbolic activity within the sets of input data, and identifying one or more commands directed to a target output mechanism based on the symbolic activity.
1. In a computing environment, a method performed at least in part on at least one processor, comprising, detecting symbolic activity between at least two users of a given environment, including receiving sets of input data corresponding to one or more input modalities, processing a model associated with context-dependent grammar for the given environment, using the model to interpret the symbolic activity within the sets of input data, and identifying one or more commands directed to a target output mechanism based on the symbolic activity. 5. The method of claim 1 further comprising determining related sets of input data based on the model.