1. A method for controlling a cooking appliance using a user's speech in a speech-based appliance controller, including the cooking appliance and an audio input device that receives an input of the user's speech, the cooking appliance including a first cooker and a second cooker, the method comprising: transmitting, to the cooking appliance via a first network, first cooking program information indicating a first cooking program, the first cooking program corresponding to a first cooking recipe, and second cooking program information indicating a second cooking program, the second cooking program corresponding to a second cooking recipe; recognizing, when instruction information including first audio information indicating operation instructions for the cooking appliance is received from the audio input device, and the first cooker is operated based on the first cooking program and the second cooker is operated based on the second cooking program, the operation instructions from the first audio information; determining, using a database that manages first cooking menu information indicating a name of a cooking menu item corresponding to the first cooking recipe and second cooking menu information indicating the name of a cooking menu item corresponding to the second cooking recipe, whether or not the received instruction information includes the first audio information and second audio information related to the first cooking menu information or the second cooking menu information; and transmitting, when it is determined that the received instruction information includes the second audio information, to the cooking appliance via the first network, a control command for causing the cooking appliance to execute a process corresponding to the operation instructions, without executing a process that is based on the first cooking program or the second cooking program corresponding to one of the first cooking menu information or the second cooking menu information to which the second audio information is related.