 The idea of quality panel evaluation was to submit translations to a panel of expert native English speakers who were professional translators and get them to evaluate them.The evaluations were done on the basis of a metric, modelled on a standard US government metric used to rate human translations.This was good from the point of view that the metric was "externally motivated", since it was not specifically developed for machine translation.