1. A method comprising: receiving a set of text derived from a speech-to-text translation of an audio signal; comparing the set of text to reference text to identify errors in the received set of text; producing a respective weighted value for each of the identified errors, a magnitude of each of the weighted values varying depending on a type of the translation error; and utilizing the weighted values to generate a metric indicating a level of quality of the set of text with respect to the reference text.
11. The method as in claim 1 , wherein comparing the set of text to the reference text to identify errors in the received set of text includes: identifying a first error, the first error being a first discrepancy between the set of text and the reference text; and identifying a second error, the second error being a second discrepancy between the set of text and the reference text.