 The judges were asked to rate the original sentence on informativeness.So, the more informative the original sentence, the lower the quality of the translation.The study showed that the variables were highly correlated when the human judgment was averaged per
sentence.