Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,72 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
+
base_model: mdeberta-v3-base
|
4 |
+
datasets:
|
5 |
+
- HiTZ/casimedicos-squad
|
6 |
+
language:
|
7 |
+
- en
|
8 |
+
- es
|
9 |
+
- fr
|
10 |
+
- it
|
11 |
+
metrics:
|
12 |
+
- f1
|
13 |
+
pipeline_tag: question-answering
|
14 |
+
library_name: transformers
|
15 |
+
widget:
|
16 |
+
- text: >-
|
17 |
+
In osteoporosis, one of the main risks associated with the increased risk of fracture is low adherence to treatment, so answer 1 is correct. Answer 2 is found in the SER guidelines, which confirm that some studies conclude that bone remodeling markers can be useful for early monitoring of adherence and response to treatment. Answer 4 is correct because again in the SER 2019 guidelines they quote: "The current scientific evidence allows us to affirm that neither increasing dietary calcium nor taking calcium supplements alone protects against the appearance of fractures". Therefore, the correct answer to this question is option 3. Patients on pharmacological treatment for OP should use calcium and vitamin D supplements because practically all clinical trials that have demonstrated efficacy of antiosteoporotic drugs routinely include calcium supplements and cholecalciferol (vitamin D3), but not in monotherapy.
|
18 |
+
- text: >-
|
19 |
+
La disuria se resolvió más rápidamente en los pacientes implantados con
|
20 |
+
103Pd, pero no se vio afectada por el uso de radioterapia suplementaria y/o
|
21 |
+
terapia de privación de andrógenos.
|
22 |
+
- text: >-
|
23 |
+
La dysurie s'est résorbée plus rapidement chez les patients implantés avec
|
24 |
+
du 103Pd, mais n'a pas été affectée par l'utilisation d'une radiothérapie
|
25 |
+
complémentaire et/ou d'une thérapie de privation d'androgènes.
|
26 |
+
- text: >-
|
27 |
+
La disuria si è risolta più rapidamente nei pazienti impiantati con 103Pd,
|
28 |
+
ma non è stata influenzata dall'uso della radioterapia supplementare e/o
|
29 |
+
della terapia di deprivazione androgenica.
|
30 |
---
|
31 |
+
|
32 |
+
<p align="center">
|
33 |
+
<br>
|
34 |
+
<img src="http://www.ixa.eus/sites/default/files/anitdote.png" style="width: 45%;">
|
35 |
+
<be>
|
36 |
+
|
37 |
+
|
38 |
+
# mDeBERTa-base for Multilingual Correct Explanation Extraction in the Medical Domain
|
39 |
+
|
40 |
+
|
41 |
+
This model is a fine-tuned version of [mdeberta-v3-base](https://huggingface.co/microsoft/mdeberta-v3-base) for a **novel extractive task**
|
42 |
+
which consists of **identifying the explanation of the correct answer** written by medical doctors. The model
|
43 |
+
has been fine-tuned using the multilingual [https://huggingface.co/datasets/HiTZ/casimedicos-squad](https://huggingface.co/datasets/HiTZ/casimedicos-squad) dataset.
|
44 |
+
|
45 |
+
|
46 |
+
## Performance
|
47 |
+
|
48 |
+
F1 partial match scores (as defined in [SQuAD extractive QA task](https://huggingface.co/datasets/rajpurkar/squad_v2) are reported in the following
|
49 |
+
table:
|
50 |
+
|
51 |
+
<img src="https://raw.githubusercontent.com/hitz-zentroa/multilingual-abstrct/main/resources/multilingual-abstrct-results.png" style="width: 75%;">
|
52 |
+
|
53 |
+
### Training hyperparameters
|
54 |
+
|
55 |
+
The following hyperparameters were used during training:
|
56 |
+
- learning_rate: 5e-05
|
57 |
+
- train_batch_size: 16
|
58 |
+
- eval_batch_size: 8
|
59 |
+
- seed: 42
|
60 |
+
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
61 |
+
- lr_scheduler_type: linear
|
62 |
+
- num_epochs: 3.0
|
63 |
+
|
64 |
+
### Framework versions
|
65 |
+
|
66 |
+
- Transformers 4.40.0.dev0
|
67 |
+
- Pytorch 2.1.2+cu121
|
68 |
+
- Datasets 2.16.1
|
69 |
+
- Tokenizers 0.15.2
|
70 |
+
|
71 |
+
**Contact**: [Anar Yeginbergen](https://ixa.ehu.eus/node/13807?language=en) and [Rodrigo Agerri](https://ragerri.github.io/)
|
72 |
+
HiTZ Center - Ixa, University of the Basque Country UPV/EHU
|