1. A modular multi-modal input system, comprising: a plurality of modal input devices, each modal input device to retrieve a stream of modal input data from a user; modal interpretation logic to interpret each of the plurality of retrieved modal input data streams into a corresponding of set of actions; modal pairing logic to assign each corresponding set of actions to control one of a plurality of displayed objects; and modal control logic to control each displayed object by its assigned set of actions.