Commit
·
c46e92e
1
Parent(s):
a48f877
Update README.md
Browse files
README.md
CHANGED
@@ -13,14 +13,14 @@ should probably proofread and complete it, then remove this comment. -->
|
|
13 |
|
14 |
# Overview
|
15 |
|
16 |
-
This model is a fine-tuned version of [allenai/led-base-16384](https://huggingface.co/allenai/led-base-16384) on the allenai/mslr2022 ms2 dataset. We take up to the first 25 included studies for each example and concatenate them with the `"</s>"` token. Global attention is applied to the special start token `"<s>"` and each of the document seperator tokens `"</s>"`.
|
17 |
|
18 |
It achieves the following results on the evaluation set:
|
19 |
- Loss: 3.7602
|
20 |
- Rouge1 Fmeasure Mean: 28.5338
|
21 |
- Rouge2 Fmeasure Mean: 9.5060
|
22 |
-
-
|
23 |
-
-
|
24 |
- Bertscore Hashcode: microsoft/deberta-xlarge-mnli_L40_no-idf_version=0.3.11(hug_trans=4.21.0.dev0)-rescaled_fast-tokenizer
|
25 |
- Bertscore F1 Mean: 22.7619
|
26 |
- Seed: 42
|
|
|
13 |
|
14 |
# Overview
|
15 |
|
16 |
+
This model is a fine-tuned version of [allenai/led-base-16384](https://huggingface.co/allenai/led-base-16384) on the allenai/mslr2022 ms2 dataset. We take up to the first 25 included studies for each example and concatenate them with the `"</s>"` token. Global attention is applied to the special start token `"<s>"` and each of the document seperator tokens `"</s>"`. The model slightly outperforms the reported results in the original paper: [MS2: Multi-Document Summarization of Medical Studies](https://arxiv.org/abs/2104.06486).
|
17 |
|
18 |
It achieves the following results on the evaluation set:
|
19 |
- Loss: 3.7602
|
20 |
- Rouge1 Fmeasure Mean: 28.5338
|
21 |
- Rouge2 Fmeasure Mean: 9.5060
|
22 |
+
- RougeL Fmeasure Mean: 20.9321
|
23 |
+
- RougeLsum Fmeasure Mean: 24.0998
|
24 |
- Bertscore Hashcode: microsoft/deberta-xlarge-mnli_L40_no-idf_version=0.3.11(hug_trans=4.21.0.dev0)-rescaled_fast-tokenizer
|
25 |
- Bertscore F1 Mean: 22.7619
|
26 |
- Seed: 42
|