1. In a computing environment, a method performed at least in part on at least one processor, comprising, detecting symbolic activity within a given environment, including receiving sets of input data corresponding to one or more input modalities, processing a model associated with context data for the given environment, using the model to interpret the symbolic activity within the sets of input data, and identifying one or more commands directed to a target output mechanism based on the symbolic activity.