1. A speech recognition system comprising the following computer-executable components: a receiver component that receives a distorted speech utterance; a plurality of compressed models usable in connection with speech recognition; an expander component that expands the plurality of compressed models; an adaptor component in communication with the receiver component, wherein the adaptor component coarsely estimates an additive distortion mean vector corresponding to the distorted speech utterance based at least in part upon a portion of the distorted speech utterance received by the receiver component, wherein the adaptor component selectively adapts parameters of a subset of compressed models in the plurality of compressed speech models based at least in part upon the coarsely estimated additive distortion mean vector; and a decoder component that decodes the received distorted speech utterance using a second subset of compressed models in the plurality of compressed models and outputs a decoded speech utterance, wherein subsequent to the decoder component outputting the decoded speech utterance, the adaptor component re-estimates the additive distortion mean vector based at least in part upon the decoded speech utterance, wherein subsequent to the adaptor component re-estimating the additive distortion mean vector, the adaptor component adapts parameters of the second subset of compressed models in the plurality of compressed models based at least in part upon re-estimating of the additive distortion mean vector, and wherein subsequent to the parameters of the second subset of compressed models in the plurality of compressed models being adapted, the decoder component decodes the received distorted speech utterance using at least one compressed model in the second subset of compressed models.