1. A method for simulating interactions using an augmented reality device, comprising: capturing a visual scene for display, wherein the visual scene includes a depiction of a first physical object within a physical environment and wherein the visual scene is captured using one or more camera devices; simulating, by operation of one or more computer processors of the augmented reality device, a dynamic interaction between the first physical object and one or more virtual objects; calculating a velocity of a first one of the one or more virtual objects, resulting from the simulated dynamic interaction between the first physical object and the first virtual object; selecting one of a plurality of predefined behaviors for a virtual character to perform in response to the dynamic interaction, wherein the virtual character is distinct from the one or more virtual objects, and wherein the selection is based on a determination that the calculated velocity of the first virtual object exceeds a predefined threshold amount of velocity; rendering a sequence of frames for display that depict the dynamic interaction between the first physical object and the one or more virtual objects and further depict a representation of the virtual character performing the determined behavior; and transmitting an instruction to a control device, to cause the control device to activate an actuator associated with a first physical device in order to move the first physical object at a specified speed and trajectory, wherein the speed and trajectory are dynamically determined based on the dynamic interaction between the physical object and the one or more virtual objects within the visual scene.