1. One or more computing devices comprising: one or more processors; one or more computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising: receiving a first audio signal generated based on a first sound captured within an environment; identifying first speech from the first audio signal, the first speech including a wake word; receiving a second audio signal generated based on a second sound captured within the environment; determining that the second audio signal includes second speech; determining whether a user that spoke the first speech is the same as a user that spoke the second speech; causing performance of an action associated with the second speech at least partly in response to determining that the user that spoke the first speech is the same as the user that spoke the second speech; and refraining from causing performance of the action associated with the second speech at least partly in response to determining that the user that spoke the first speech is not the same as the user that spoke the second speech.
2. One or more computing devices as recited in claim 1 , the acts further comprising: receiving a third audio signal generated based on a third sound captured within the environment; determining that the third audio signal includes third speech; determining whether the user that spoke the first speech is the same as a user that spoke the third speech; causing performance of an action associated with the third speech at least partly in response to determining that the user that spoke the first speech is the same as the user that spoke the third speech; and refraining from causing performance of the action associated with the third speech at least partly in response to determining that the user that spoke the first speech is not the same as the user that spoke the third speech.