1. An object controlling apparatus, comprising: an input unit to receive, from an input device, a pointing signaling for manipulating an object of a virtual world; a database to store object information associated with the object; and a controller to control at least one of an operation, a state, and a shape of the object based on the pointing signal and the object information.