 However, the quality panel evaluation was very difficult to set up logistically, as it necessitated having a number of experts together in one place for a week or more, and furthermore for them to reach consensus.This method was also abandoned.Along with a modified form of the comprehension evaluation (re-styled as informativeness evaluation), the most
popular method was to obtain ratings from monolingual judges for segments of a document.