1 ▁( 1 9 9 8 ), ▁S ense val - 2 ▁( 2 0 0 1 ), ▁S ense val - 3 ▁( 2 0 0 4 ), ▁and ▁its ▁successor , ▁Sem E val ▁( 2 0 0 7 ). ▁The ▁objective ▁of ▁the ▁competition ▁is ▁to ▁organ ize ▁different ▁lect ures , ▁prepar ing ▁and ▁hand - annot ating ▁cor pus ▁for ▁testing ▁systems , ▁perform ▁a ▁compar ative ▁evaluation ▁of ▁W SD ▁systems ▁in ▁several ▁kinds ▁of ▁tasks , ▁including ▁all - words ▁and ▁lex ical ▁sample ▁W SD ▁for ▁different ▁languages , ▁and , ▁more ▁recently , ▁new ▁tasks ▁such ▁as ▁semantic ▁role ▁label ing , ▁gl oss ▁W SD , ▁lex ical ▁substitution , ▁etc . ▁The ▁systems ▁submitted ▁for ▁evaluation ▁to ▁these ▁compet itions ▁usually ▁integrate ▁different ▁techniques ▁and ▁often ▁combine ▁super vised ▁and ▁knowledge - based ▁methods ▁( es pecially ▁for ▁avoid ing ▁bad ▁performance ▁in ▁lack ▁of ▁training ▁examples ). ▁ ▁In ▁recent ▁years ▁ 2 0 0 7 - 2 0 1 2 , ▁the ▁W SD ▁evaluation ▁task ▁choices ▁had ▁grown ▁and ▁the ▁criter ion ▁for ▁evalu ating ▁W SD ▁has ▁changed ▁dr ast ically ▁depending ▁on ▁the ▁variant ▁of ▁the ▁W SD ▁evaluation ▁task . ▁Below ▁enumer ates ▁the ▁variety ▁of ▁W SD ▁tasks : ▁ ▁Task ▁design ▁choices ▁As ▁technology ▁evol ves , ▁the ▁Word ▁S ense ▁Dis ambiguation ▁( W SD ) ▁tasks ▁grows ▁in ▁different ▁flav ors ▁towards ▁various ▁research ▁directions ▁and ▁for ▁more ▁languages : ▁ ▁Classic