1. A computer-implemented method comprising: receiving, by a first user device, an audio signal encoding an utterance; obtaining, by the first user device, a first speaker model that is specific to a first user of the first user device; determining, by the first user device, that a second user device used by a second user is co-located with the first user device; in response to determining that the second user device used by the second user is co-located with the first user device and receiving, by the first user device, the audio signal encoding the utterance, determining, by the first user device, whether the first user device has one or more settings that allow the first user device access to a second speaker model that is specific to the second user; in response to determining that the first user device has one or more settings that allow the first user device access to the second speaker model, obtaining, by the first user device from the second user device used by the second user, a second speaker model that is specific to the second user; determining, by the first user device, that the utterance was spoken by the first user using the first speaker model that is specific to the first user of the first user device and the second speaker model that is specific to the second user associated with the second user device; analyzing the audio signal to identify a command included in the utterance in response to determining that the utterance was spoken by the first user; and performing an action that corresponds with the command.
1. A computer-implemented method comprising: receiving, by a first user device, an audio signal encoding an utterance; obtaining, by the first user device, a first speaker model that is specific to a first user of the first user device; determining, by the first user device, that a second user device used by a second user is co-located with the first user device; in response to determining that the second user device used by the second user is co-located with the first user device and receiving, by the first user device, the audio signal encoding the utterance, determining, by the first user device, whether the first user device has one or more settings that allow the first user device access to a second speaker model that is specific to the second user; in response to determining that the first user device has one or more settings that allow the first user device access to the second speaker model, obtaining, by the first user device from the second user device used by the second user, a second speaker model that is specific to the second user; determining, by the first user device, that the utterance was spoken by the first user using the first speaker model that is specific to the first user of the first user device and the second speaker model that is specific to the second user associated with the second user device; analyzing the audio signal to identify a command included in the utterance in response to determining that the utterance was spoken by the first user; and performing an action that corresponds with the command. 7. The method of claim 1 comprising: determining, by the first user device, one or more third speaker models, stored on the first user device, for other people who may be located in a physical area near a physical location of the first user device; and determining, by the first user device, that the utterance was spoken by the first user using the first speaker model that is specific to the first user of the first user device, the second speaker model that is specific to the second user associated with the second user device, and the third speaker models for other people who may be located in a physical area near a physical location of the first user device.