TajaKuzman commited on
Commit
26db48a
·
verified ·
1 Parent(s): 5d3248b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -134,8 +134,8 @@ The model can be used for classification into topic labels from the
134
  applied to any news text in a language, supported by the `xlm-roberta-large`.
135
 
136
  Based on a manually-annotated test set (in Croatian, Slovenian, Catalan and Greek),
137
- the model achieves accuracy of 0.84 and macro-F1 scores of 0.78 on instances, predicted with confidence level above 0.90 (80% of test set).
138
- If we do not filter out instances, predicted with lower confidence score, the model achieves still a high accuracy of 0.78 and macro-F1 score of 0.72.
139
 
140
  ## Intended use and limitations
141
 
 
134
  applied to any news text in a language, supported by the `xlm-roberta-large`.
135
 
136
  Based on a manually-annotated test set (in Croatian, Slovenian, Catalan and Greek),
137
+ the model achieves micro-F1 score of 0.734, macro-F1 score of 0.746 and accuracy of 0.734,
138
+ and outperforms the GPT-4o model (version `gpt-4o-2024-05-13`) used in a zero-shot setting.
139
 
140
  ## Intended use and limitations
141