15. A system comprising: a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising: recognizing speech of each speaker of a plurality of speakers on a conference call, to yield recognized speech for each of the plurality of speakers, wherein the speech of each speaker from the plurality of speakers is received via a speech interface; recording metrics associated with the recognized speech for each of the plurality of speakers, wherein the metrics comprise a request for repetition, a negative response to confirmation, and a task completion; after recording the metrics, while recording further speech from the each speaker from the plurality of speakers, modifying an allocation of resources of the speech interface based on the metrics, to yield a modified speech interface; and recognizing additional speech during the conference call from an identified speaker in the plurality of speakers using the modified speech interface.
15. A system comprising: a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, result in the processor performing operations comprising: recognizing speech of each speaker of a plurality of speakers on a conference call, to yield recognized speech for each of the plurality of speakers, wherein the speech of each speaker from the plurality of speakers is received via a speech interface; recording metrics associated with the recognized speech for each of the plurality of speakers, wherein the metrics comprise a request for repetition, a negative response to confirmation, and a task completion; after recording the metrics, while recording further speech from the each speaker from the plurality of speakers, modifying an allocation of resources of the speech interface based on the metrics, to yield a modified speech interface; and recognizing additional speech during the conference call from an identified speaker in the plurality of speakers using the modified speech interface. 19. The system of claim 15 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising storing a speaker personalization profile having information for the modified speech interface.