11. A system comprising: a processor; and a computer-readable storage medium having instruction stored which, when executed by the processor, result in the processor performing operations comprising: identifying, based on speech from a user, a speech pattern of the user; identifying, based on the speech pattern of the user, a plurality of speech recognition models, each speech recognition model of the plurality of speech recognition models being from a respective speech recognition domain; combining the plurality of speech recognition models, to yield a multi-domain combined speech recognition model; when sample data associated with a specific speech recognition domain is more than a threshold, generating a new domain-specific speech recognition model for the specific speech recognition domain; and when the sample data is less than the threshold, modifying the multi-domain combined speech recognition model by weighting components of the multi-domain combined speech recognition model associated with the specific speech recognition domain to recognize the speech or additional speech from the user.
11. A system comprising: a processor; and a computer-readable storage medium having instruction stored which, when executed by the processor, result in the processor performing operations comprising: identifying, based on speech from a user, a speech pattern of the user; identifying, based on the speech pattern of the user, a plurality of speech recognition models, each speech recognition model of the plurality of speech recognition models being from a respective speech recognition domain; combining the plurality of speech recognition models, to yield a multi-domain combined speech recognition model; when sample data associated with a specific speech recognition domain is more than a threshold, generating a new domain-specific speech recognition model for the specific speech recognition domain; and when the sample data is less than the threshold, modifying the multi-domain combined speech recognition model by weighting components of the multi-domain combined speech recognition model associated with the specific speech recognition domain to recognize the speech or additional speech from the user. 19. The system of claim 11 , wherein the modifying of the multi-domain combined speech recognition model further comprises sampling the speech.