17. One or more computer-readable storage media having computer-executable instructions, which when executed perform steps, comprising: processing input events corresponding to a plurality of input modalities within a given environment; interpreting symbolic activity from the input events using a context-dependent grammar associated with the given environment, the context-dependent grammar to capture syntactic input events in relation to semantics of the syntactic input events; and converting the symbolic activity into one or more commands for a target output mechanism; and instructing the target output mechanism to execute the one or more commands.
19. The one or more computer-readable storage media of claim 17 having further computer-executable instructions comprising: sensing one or more physical objects within the given environment; and creating profiles for the one or more physical objects.