saattrupdan commited on
Commit
bf2ec66
·
1 Parent(s): 0deae3c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -11,7 +11,15 @@ widget:
11
 
12
  This model is a fine-tuned version of [Maltehb/aelaectra-danish-electra-small-cased](https://huggingface.co/Maltehb/aelaectra-danish-electra-small-cased) on a dataset consisting of approximately 5 million Facebook comments on [DR's](https://dr.dk/) public Facebook pages. The labels have been automatically generated using weak supervision, based on the [Snorkel](https://www.snorkel.org/) framework.
13
 
14
- The model has been evaluated on a test set consisting of 500 samples.
 
 
 
 
 
 
 
 
15
 
16
  ## Training procedure
17
 
 
11
 
12
  This model is a fine-tuned version of [Maltehb/aelaectra-danish-electra-small-cased](https://huggingface.co/Maltehb/aelaectra-danish-electra-small-cased) on a dataset consisting of approximately 5 million Facebook comments on [DR's](https://dr.dk/) public Facebook pages. The labels have been automatically generated using weak supervision, based on the [Snorkel](https://www.snorkel.org/) framework.
13
 
14
+ The model achieves SOTA on a test set consisting of 500 Facebook comments annotated by two people, of which X% were labelled as offensive:
15
+
16
+ | **Model** | **Precision** | **Recall** | **F1-score** |
17
+ | :-------- | :------------ | :--------- | :----------- |
18
+ | `alexandrainst/electra-small-offensive-text-detection-da` | 85.45% | 91.26% | *88.26%* |
19
+ | `alexandrainst/xlm-roberta-base-offensive-text-detection-da` | 83.48% | *93.20%* | 88.07% |
20
+ | [`A-ttack`](https://github.com/ogtal/A-ttack) | *99.17%* | 58.25% | 73.39% |
21
+ | [`DaNLP/da-electra-hatespeech-detection`](https://huggingface.co/DaNLP/da-electra-hatespeech-detection) | 92.19% | 57.28% | 70.66% |
22
+ | [`Guscode/DKbert-hatespeech-detection`](https://huggingface.co/Guscode/DKbert-hatespeech-detection) | 84.91% | 43.69% | 57.69% |
23
 
24
  ## Training procedure
25