Classic WSD task, restricted to only 20 polysemous nouns. It is worth noting that the SemEval-2014 have only two tasks that were multilingual/crosslingual, i.e. (i) the L2 Writing Assistant task, which is a crosslingual WSD task that includes English, Spanish, German, French and Dutch and (ii) the Multilingual Semantic Textual Similarity task that evaluates systems on English and Spanish texts. Areas of evaluation The major tasks in semantic evaluation include the following areas of natural language processing. This list is expected to grow as the field progresses. The following table shows the areas of studies that were involved in Senseval-1 through SemEval-2014 (S refers to Senseval and SE refers to SemEval, e.g. S1 refers to Senseval-1 and SE07 refers to SemEval2007): Type of Semantic Annotations SemEval tasks have created many types of semantic annotations, each type with various schema. In SemEval-2015, the organizers have decided to group tasks together into several tracks. These tracks are by the type of semantic annotations that the task hope to achieve. Here lists the type of semantic annotations involved in the SemEval workshops: Learning Semantic Relations Question and Answering Semantic Parsing Semantic Taxonomy Sentiment Analysis Text Similarity Time and Space Word Sense Disambiguation and Induction A task and its track allocation is flexible; a task might develop into its own track, e.g. the taxonomy evaluation task in SemEval-2015 was under the Learning Semantic Relations track and in SemEval-2016, there is a dedicated track for Semantic Taxonomy with a new Semantic Taxonomy Enrichment task. See also List of computer science awards Computational semantics Natural language processing Word sense Word sense disambiguation Different variants of WSD evaluations Semantic analysis (computational) References External links Special Interest Group on the Lexicon (SIGLEX) of the Association for Computational Linguistics (ACL) Semeval-2010 - Semantic Evaluation Workshop (endorsed by SIGLEX) Senseval - international organization devoted to the evaluation of Word Sense Disambiguation Systems (endorsed by SIGLEX) SemEval Portal on the Wiki of the Association for Computational Linguistics Senseval / SemEval tasks: Senseval-1 - the first evaluation exercise on word sense disambiguation systems; the lexical-sample task was evaluated on English, French and Italian Senseval-2 - evaluated word sense disambiguation systems on three types of tasks (the all-words, lexical-sample and the translation task) Senseval-3 - included tasks for word sense disambiguation, as well as identification of semantic roles, multilingual annotations, logic forms, subcategorization acquisition. SemEval-2007 - included tasks which were more elaborate than