 The judges were presented with a segment, and asked to rate it for two variables, adequacy and fluency.Adequacy is a rating of how much information is transferred between the original and the translation, and fluency is a rating of how good the English is.This technique was found to cover the relevant parts of the quality panel evaluation, while at the same time being easier to deploy, as it didn't require expert judgment.