Commit
·
bf2ec66
1
Parent(s):
0deae3c
Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,15 @@ widget:
|
|
11 |
|
12 |
This model is a fine-tuned version of [Maltehb/aelaectra-danish-electra-small-cased](https://huggingface.co/Maltehb/aelaectra-danish-electra-small-cased) on a dataset consisting of approximately 5 million Facebook comments on [DR's](https://dr.dk/) public Facebook pages. The labels have been automatically generated using weak supervision, based on the [Snorkel](https://www.snorkel.org/) framework.
|
13 |
|
14 |
-
The model
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
|
16 |
## Training procedure
|
17 |
|
|
|
11 |
|
12 |
This model is a fine-tuned version of [Maltehb/aelaectra-danish-electra-small-cased](https://huggingface.co/Maltehb/aelaectra-danish-electra-small-cased) on a dataset consisting of approximately 5 million Facebook comments on [DR's](https://dr.dk/) public Facebook pages. The labels have been automatically generated using weak supervision, based on the [Snorkel](https://www.snorkel.org/) framework.
|
13 |
|
14 |
+
The model achieves SOTA on a test set consisting of 500 Facebook comments annotated by two people, of which X% were labelled as offensive:
|
15 |
+
|
16 |
+
| **Model** | **Precision** | **Recall** | **F1-score** |
|
17 |
+
| :-------- | :------------ | :--------- | :----------- |
|
18 |
+
| `alexandrainst/electra-small-offensive-text-detection-da` | 85.45% | 91.26% | *88.26%* |
|
19 |
+
| `alexandrainst/xlm-roberta-base-offensive-text-detection-da` | 83.48% | *93.20%* | 88.07% |
|
20 |
+
| [`A-ttack`](https://github.com/ogtal/A-ttack) | *99.17%* | 58.25% | 73.39% |
|
21 |
+
| [`DaNLP/da-electra-hatespeech-detection`](https://huggingface.co/DaNLP/da-electra-hatespeech-detection) | 92.19% | 57.28% | 70.66% |
|
22 |
+
| [`Guscode/DKbert-hatespeech-detection`](https://huggingface.co/Guscode/DKbert-hatespeech-detection) | 84.91% | 43.69% | 57.69% |
|
23 |
|
24 |
## Training procedure
|
25 |
|