1. A method comprising: receiving, by a computer-based speech recognition system that is communicatively coupled to a communication network, a speech input including one or more words or phrases, the computer-based speech recognition system comprising at least one processor and at least one memory device, wherein the speech input is from a call to a call center via the communication network; determining, by the computer-based speech recognition system, to provide the speech input to a human; receiving a response from the human that identifies a first task for the speech input, the first task including a first transcription of the speech input; performing the first task that is identified by the human for the speech input; processing the speech input to identify a second task for the speech input, the processing using a set of internal representations of the computer-based speech recognition system, the set of internal representations comprising one or more machine-readable parameters for recognizing speech in a speech utterance, the second task including a second transcription of the speech input; comparing the first transcription of the speech input included in the first task identified by the human with the second transcription of the speech input included in the second task identified by the computer-based recognition system to determine one or more differences between the first transcription and the second transcription; modifying the set of internal representations of the computer-based speech recognition system based at least in part on the one or more differences between the first transcription and the second transcription to create a modified set of internal representations, wherein the modifying includes adjusting at least a portion of the set of internal representations; checking the performance of the modified set of internal representations to prevent the modification from degrading the set internal representations, wherein the checking comprises determining that a performance difference between the set of internal representations before and after modification is within a margin of error; receiving, by the computer-based speech recognition system, another input; and processing, by the at least one processor and based at least in part on the modified set of internal representations, the other input to identify a third task for the other input.