1. An interactive spoken dialog system, comprising: a computer including a processor, and non-transitory memory, including: a data store for storing recordings of interactions on the spoken dialog system; a data store for feature data defining a number of features, wherein the features include a set of features selected from the group of: the classification status of a call, the number of speech recognition errors during a call, the number of operator requests from a caller, and the exit status of the call; and an automated rater including a machine-learning algorithm configured to automatically estimate a user experience score for any set of interactions on the spoken dialog system.
1. An interactive spoken dialog system, comprising: a computer including a processor, and non-transitory memory, including: a data store for storing recordings of interactions on the spoken dialog system; a data store for feature data defining a number of features, wherein the features include a set of features selected from the group of: the classification status of a call, the number of speech recognition errors during a call, the number of operator requests from a caller, and the exit status of the call; and an automated rater including a machine-learning algorithm configured to automatically estimate a user experience score for any set of interactions on the spoken dialog system. 4. The system of claim 1 wherein the system is configured to use the rater's automated estimate in conjunction with a human evaluator estimates to score the set of interaction recordings to obtain an overall user experience score.