1. A modular multi-modal input system, comprising: a plurality of modal input devices, each modal input device to retrieve a stream of modal input data from a user; modal interpretation logic to interpret each of the plurality of retrieved modal input data streams into a corresponding of set of actions; modal pairing logic to assign each corresponding set of actions to control one of a plurality of displayed objects, wherein modal pairing logic implements a user interface to enable the user to explicitly assign each stream of modal input to a display object; and modal control logic to control each displayed object by its assigned set of actions, wherein each of the plurality of modal input devices captures a different type of modal input data corresponding with a different type of gameplay action, wherein the modal pairing logic is operable to dynamically change a control assignment of a first displayed object of the plurality of displayed objects from a first modal input data stream of a first type of input device having a first type of data to a second modal input data stream of a second type of input device having a second type of data different from the first type of data.