1. An audio device control device comprising: speech recognition means which acquires speech data representing a speech, and specifies a candidate for a phrase represented by said speech by performing speech recognition on said speech data; operational status information acquisition means which acquires operational status information indicating an operational status of an audio device to be controlled; and audio device control means which specifies a use mode of said audio device desired by an utterer of said speech, based on the candidate specified by said speech recognition means, and an operation to be applied to said audio device to realize said use mode, based on the operational status information acquired by said operational status information acquisition means, and controls said audio device to apply the specified operation.