1. A virtual environment system comprising: a database of virtual environment objects; a display for displaying appearance of virtual environment objects; a processor coupled to said database and said display for displaying virtual environment objects dependent on speech input; said database storing information about possible natural interaction of a user with said virtual environment objects as attributes of said virtual environment objects along with graphical information describing said object's visual appearance; and a recognizer coupled to said processor and responsive to said natural interaction of said user for recognizing said natural interaction of said user to manipulate said virtual environment objects.