2. The system of claim 1 , wherein generating one or more audio quality metrics that reflect the audio quality of the audio signal output by the test audio subsystem configuration of the mobile device or the mockup of the mobile device further comprises comparing the audio signal to the pre-recorded test utterance.
2. The system of claim 1 , wherein generating one or more audio quality metrics that reflect the audio quality of the audio signal output by the test audio subsystem configuration of the mobile device or the mockup of the mobile device further comprises comparing the audio signal to the pre-recorded test utterance. 3. The system of claim 2 , wherein the operations further comprise: receiving audio test data including the pre-recorded test utterance and a transcription associated with the pre-recorded test utterance.