1. An object controlling apparatus, comprising: an input unit to receive, from an input device, a pointing signal for manipulating an object of a virtual world; a database to store object information associated with the object including a transform of the object; a decision unit to determine that the received pointing signal is a valid signal when the received pointing signal matches the transform of the object stored in the database and to determine that the received pointing signal is an invalid signal when the received pointing signal does not match the transform of the object; and a controller to control at least one of an operation, a state, and a shape of the object based on the received pointing signal and the object information when the decision unit determines that the received pointing signal matches the transform of the object stored in the database and otherwise to not control the operation, the state, or the shape of the object based on the received pointing signal when the decision unit determines that the received pointing signal is the invalid signal.