Evaluation Comparing and evaluating different WSD systems is extremely difficult, because of the different test sets, sense inventories, and knowledge resources adopted. Before the organization of specific evaluation campaigns most systems were assessed on in-house, often small-scale, data sets. In order to test one's algorithm, developers should spend their time to annotate all word occurrences. And comparing methods even on the same corpus is not eligible if there is different sense inventories.
Evaluation Comparing and evaluating different WSD systems is extremely difficult because of the different test sets sense inventories and knowledge resources adopted Before the organization of specific evaluation campaigns most systems were assessed on in-house often small-scale data sets In order to test one's algorithm developers should spend their time to annotate all word occurrences And comparing methods even on the same corpus is not eligible if there is different sense inventories