1. In a computing environment, a method performed at least in part on at least one processor, comprising: receiving, by a speech recognition system, spoken utterances and associated confirmations; processing, by a classifier of the speech recognition system, the spoken utterances and associated confirmations from output data associated with the speech recognition system, including for each spoken utterance having a denied confirmation, assigning a pseudo-semantic label that is a representation of an association between the denied confirmation and a rejected semantic label selected from a set of potential semantic labels, and updating a classification model associated with the classifier using each assigned pseudo-semantic label, wherein the denied confirmation comprises determining a negative response to a confirmation prompt delivered by the speech recognition system.