2 Plan theoretical background, the resources employed and the process of integrating the Polish language into MTE including: 1) specifying a MTE-compliant tagset for it with an indication of the restrictions on combinations of attributes; 2) creating, or rather converting, a representative lexicon consisting of word forms with tags; 3) tagging a sample text basing on the prepared resources.
3 Design of the tagset Our proposal takes into account the following: the consistency of MTE specifications, the specific features of the language, the possibility of automatic disambiguation of feature values, the de-facto standardin our case, the IPIC tagset [Wolinski, Przepiórkowski 2003].
5 Specific features for Polish ctd. Pronouns: Type (personal, demonstrative, indefinite, possessive, interrogative, relative, reflexive, negative, general) – supplied by hand; further division by the features Referent_Type (personal, possessive) and Syntactic_Type (nominal, adjectival, adverbial). The feature Clitic (yes, no, agglutinant) distinguishes postprepositional forms (nią, niego) from regular ones (ją, go) and bound (agglutinating) clitics (-ń). The feature Definiteness (full-art, short-art) serves to separate full forms of pronouns (jego, niego) from short ones (go, -ń).
6 Specific features for Polish ctd. Adverb: Clitic (no, yes, agglutinant, burkinostka) polsko in polsko-ukraiński Polish–Ukrainian considered agglutinating adverbs polsku in po polsku in Polish are likewise classified as special kinds of adjectives in the IPIC, here labelled as a burkinostka.
9 Conversion of tags The collected tags amounted to 1295, including 898 tags from the small corpus and 397 tags from the big corpus that were absent in the small one. The tags were further split into their minimal values and recorded in a relational database with each value taking a separate column. Then the notation of values was replaced by the MTE one and their order was rearranged to fit the new tagset.
10 A large part of the original tags were mapped unconditionally. The rest had to be mapped on several MTE tags and the conditions of mapping were defined by special lists of lexemes that had to be treated as separate groups.
11 Types of tag matching those that are mapped to exactly one tag in the MTE map (1192 tags): comparative and superlative degree forms of adjectives, verbs, adjectival participles, gerunds, cardinal numerals, depreciative nouns, personal and reflexive pronouns, plural forms of nouns, prepositions. those subjected to additional division into MTE groups, first of all qubliks and non-personal pronouns. new tags: collective numerals, some missing pronoun forms that where deduced. tags that were combined into one.
13 Distribution of qubliks in MTE projection CategoryExampleMTE tagsTokens Calboż111 Ihej1179 Pjakoś, się1685 Qże274 Rwczoraj4233 Sponad27 Xmocium18 Figure 1. Distribution of qubliks in MTE projection.
15 Collapsing the IPIC tags, statistics 3rd person personal pronouns (ppron3 flexeme in the IPIC) in general foresees 287 different IPIC tags that serve to describe 5 lemmas and their 23 forms 65 MTE tags. 1 st and 2 nd person personal tags (flexeme ppron12); 146 original IPIC tags 30 MTE ones. 42 forms of personal pronouns in the IPIC and 433 tags for them, which were collapsed to 95 in the MTE version tags per word form: starting from the form nim with 53 interpretations in IPIC, followed by nich 33 and nimi 25 (16 forms with 10 or more interpretations) to mu, jemu, ją with 3 or 4 interpretations.
19 A fragment of the lexicon absurdami absurd N-mnnpi 17 absurdem absurd N-mnnsi 307 absurdom absurd N-mnnpd 6 absurdowi absurd N-mnnsd 4 absurdu absurd N-mnnsg 578 absurdy absurd N-mnnpa 59 absurdy absurd N-mnnpn 58 absurdzie absurd N-mnnsl 17 absurdów absurd N-mnnpg 163 aby aby C 201168 ac ac X 1099 ach ach I 1170 15 thousand most frequent lemmas were extracted from IPIC with the help of Poliqarp The total number of unique word forms in the lexicon is 175848 (roughly 11.72 per lemma), while the number of forms with all possible interpretations is 339031.
20 The corpus: George Orwells 1984 (pl) Był jasny, zimny dzień kwietniowy i zegary biły trzynastą.
Download ppt "Integrating the Polish language into the MULTEXT-East family: morphosyntactic specifications, converter, lexicon and corpus Natalia Kotsyba, Adam Radziszewski,"
LABELING TURKISH NEWS STORIES WITH CRF Prof. Dr. Eşref Adalı ISTANBUL TECHNICAL UNIVERSITY COMPUTER ENGINEERING 1.
Discrete Math Recurrence Relations 1.
MULTEXT-East Version 4: multilingual morphosyntactic specifications for lots of languages Tomaž Erjavec Department of Knowledge Technologies.
Demonstration of the Microcomparative Morphosyntactic Research Tool MIMORE Sjef Barbiers, Matthijs Brouwer, Jan Pieter Kunst, Folkert de Vriend Meertens.
MULTEXT-East Version 4: Multilingual Morphosyntactic Specifications, Lexicons and Corpora Tomaž Erjavec Department of Knowledge Technologies Jožef.
Written Elements Words: Phrases: Clauses: Sentences: Paragraphs: “Atomic” level Related words Subject and verb Independent expression Unity and coherence.
Written Elements Word: Phrase: Clause: Sentence: Paragraph: “Atomic” level of writing Group of related words Subject and verb Independent expression Unity.