11. A system comprising: a processor; and a computer-readable storage medium having instruction stored which, when executed by the processor, result in the processor performing operations comprising: receiving speech from a user as part of a speech dialog between the user and a speech recognition service; identifying, based on the speech, a speech pattern of the user; identifying, based on the speech pattern of the user, a plurality of speech recognition models stored in a cloud computing storage environment, each speech recognition model of the plurality of speech recognition models being from a respective speech recognition domain; combining the plurality of speech recognition models, to yield a multi-domain combined speech recognition model; identifying in the speech a specific speech recognition domain, wherein the specific speech recognition domain does not match a specific speech recognition model in the plurality of speech recognition models; receiving sample data associated with the specific speech recognition domain, wherein the sample data is independent of the speech dialog between the user and the speech recognition service; when the sample data is more than a minimum threshold, generating a new domain-specific speech recognition model for the specific speech recognition domain; and when sample data is less than the minimum threshold, modifying the multi-domain combined speech recognition model specifically to the specific speech recognition domain by weighting components of the multi-domain combined speech recognition model associated with the specific speech recognition domain to have more influence in recognition of the speech from the user.
15. The system of claim 11 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, cause the processor to perform operations comprising receiving, in addition to the speech specific to the specific speech recognition domain, one of text, transition data, metadata, and audio, specific to the specific speech recognition domain.