1. A method comprising: identifying, based on speech from a user, a speech pattern of the user; identifying, based on the speech pattern of the user, a plurality of speech recognition models, each speech recognition model of the plurality of speech recognition models being from a respective speech recognition domain; combining, via a processor, the plurality of speech recognition models, to yield a multi-domain combined speech recognition model; when sample data associated with a specific speech recognition domain is more than a threshold, generating a new domain-specific speech recognition model for the specific speech recognition domain; and when the sample data is less than the threshold, modifying the multi-domain combined speech recognition model by weighting components of the multi-domain combined speech recognition model associated with the specific speech recognition domain to recognize the speech or additional speech from the user.