Update README.md
Browse files
README.md
CHANGED
@@ -19,6 +19,8 @@ tags:
|
|
19 |
|
20 |
This model is a fine-tuned version of ```facebook/bart-large``` trained on the ```sentence-transformers/sentence-compression``` dataset. The goal of this model is to generate compressed versions of input sentences while maintaining fluency and meaning.
|
21 |
|
|
|
|
|
22 |
### Training Details
|
23 |
|
24 |
Base Model: ```facebook/bart-large```
|
@@ -37,19 +39,18 @@ Evaluation Metric for Best Model: SARI Penalized
|
|
37 |
|
38 |
Precision Mode: FP16 for efficient training
|
39 |
|
|
|
40 |
### Evaluation Results
|
41 |
|
42 |
### Validation Set Performance:
|
43 |
|
44 |
-
|
45 |
-
|
46 |
-
SARI
|
47 |
-
|
48 |
-
ROUGE-1
|
49 |
-
|
50 |
-
ROUGE-
|
51 |
-
|
52 |
-
ROUGE-L: 92.98
|
53 |
|
54 |
### Test Set Performance:
|
55 |
|
@@ -63,6 +64,7 @@ ROUGE-2: 88.65
|
|
63 |
|
64 |
ROUGE-L: 93.07
|
65 |
|
|
|
66 |
### Training Loss Curve
|
67 |
|
68 |
The loss curves during training are visualized in bart-large-sentence-compression_loss.eps, showing both training and evaluation loss over steps.
|
|
|
19 |
|
20 |
This model is a fine-tuned version of ```facebook/bart-large``` trained on the ```sentence-transformers/sentence-compression``` dataset. The goal of this model is to generate compressed versions of input sentences while maintaining fluency and meaning.
|
21 |
|
22 |
+
---
|
23 |
+
|
24 |
### Training Details
|
25 |
|
26 |
Base Model: ```facebook/bart-large```
|
|
|
39 |
|
40 |
Precision Mode: FP16 for efficient training
|
41 |
|
42 |
+
---
|
43 |
### Evaluation Results
|
44 |
|
45 |
### Validation Set Performance:
|
46 |
|
47 |
+
| Metric | Score |
|
48 |
+
|---------------------|-------|
|
49 |
+
| SARI | 89.68 |
|
50 |
+
| SARI Penalized | 88.42 |
|
51 |
+
| ROUGE-1 | 93.05 |
|
52 |
+
| ROUGE-2 | 88.47 |
|
53 |
+
| ROUGE-L | 92.98 |
|
|
|
|
|
54 |
|
55 |
### Test Set Performance:
|
56 |
|
|
|
64 |
|
65 |
ROUGE-L: 93.07
|
66 |
|
67 |
+
---
|
68 |
### Training Loss Curve
|
69 |
|
70 |
The loss curves during training are visualized in bart-large-sentence-compression_loss.eps, showing both training and evaluation loss over steps.
|