▁sens es , ▁to ▁machine - read able ▁diction aries , ▁th esa uri , ▁gl oss aries , ▁ont ologies , ▁etc . ▁They ▁can ▁be ▁class ified ▁as ▁follows : ▁ ▁Struct ured : ▁▁ ▁Machine - read able ▁diction aries ▁( MR D s ) ▁ ▁Ont ologies ▁ ▁Th esa uri ▁ ▁Un struct ured : ▁▁ ▁Col location ▁resources ▁ ▁Other ▁resources ▁( such ▁as ▁word ▁frequency ▁lists , ▁stop lists , ▁domain ▁labels , ▁etc .) ▁ ▁Corpor a : ▁raw ▁corpor a ▁and ▁sense - annot ated ▁corpor a ▁▁ ▁E valu ation ▁ ▁Compar ing ▁and ▁evalu ating ▁different ▁W SD ▁systems ▁is ▁extremely ▁difficult , ▁because ▁of ▁the ▁different ▁test ▁sets , ▁sense ▁invent ories , ▁and ▁knowledge ▁resources ▁adopted . ▁Before ▁the ▁organization ▁of ▁specific ▁evaluation ▁campaign s ▁most ▁systems ▁were ▁ass essed ▁on ▁in - house , ▁often ▁small - scale , ▁data ▁sets . ▁In ▁order ▁to ▁test ▁one ' s ▁algorithm , ▁developers ▁should ▁spend ▁their ▁time ▁to ▁annot ate ▁all ▁word ▁occurr ences . ▁And ▁comparing ▁methods ▁even ▁on ▁the ▁same ▁cor pus ▁is ▁not ▁el ig ible ▁if ▁there ▁is ▁different ▁sense ▁invent ories . ▁ ▁In ▁order ▁to ▁define ▁common ▁evaluation ▁datasets ▁and ▁procedures , ▁public ▁evaluation ▁campaign s ▁have ▁been ▁organized . ▁S ense val ▁( now ▁renamed ▁Sem E val ) ▁is ▁an ▁international ▁word ▁sense ▁dis ambiguation ▁competition , ▁held ▁every ▁three ▁years ▁since ▁ 1 9 9 8 : ▁S ense val -