Update README.md
Browse files
README.md
CHANGED
|
@@ -19,6 +19,8 @@ tags:
|
|
| 19 |
|
| 20 |
This model is a fine-tuned version of ```facebook/bart-large``` trained on the ```sentence-transformers/sentence-compression``` dataset. The goal of this model is to generate compressed versions of input sentences while maintaining fluency and meaning.
|
| 21 |
|
|
|
|
|
|
|
| 22 |
### Training Details
|
| 23 |
|
| 24 |
Base Model: ```facebook/bart-large```
|
|
@@ -37,19 +39,18 @@ Evaluation Metric for Best Model: SARI Penalized
|
|
| 37 |
|
| 38 |
Precision Mode: FP16 for efficient training
|
| 39 |
|
|
|
|
| 40 |
### Evaluation Results
|
| 41 |
|
| 42 |
### Validation Set Performance:
|
| 43 |
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
SARI
|
| 47 |
-
|
| 48 |
-
ROUGE-1
|
| 49 |
-
|
| 50 |
-
ROUGE-
|
| 51 |
-
|
| 52 |
-
ROUGE-L: 92.98
|
| 53 |
|
| 54 |
### Test Set Performance:
|
| 55 |
|
|
@@ -63,6 +64,7 @@ ROUGE-2: 88.65
|
|
| 63 |
|
| 64 |
ROUGE-L: 93.07
|
| 65 |
|
|
|
|
| 66 |
### Training Loss Curve
|
| 67 |
|
| 68 |
The loss curves during training are visualized in bart-large-sentence-compression_loss.eps, showing both training and evaluation loss over steps.
|
|
|
|
| 19 |
|
| 20 |
This model is a fine-tuned version of ```facebook/bart-large``` trained on the ```sentence-transformers/sentence-compression``` dataset. The goal of this model is to generate compressed versions of input sentences while maintaining fluency and meaning.
|
| 21 |
|
| 22 |
+
---
|
| 23 |
+
|
| 24 |
### Training Details
|
| 25 |
|
| 26 |
Base Model: ```facebook/bart-large```
|
|
|
|
| 39 |
|
| 40 |
Precision Mode: FP16 for efficient training
|
| 41 |
|
| 42 |
+
---
|
| 43 |
### Evaluation Results
|
| 44 |
|
| 45 |
### Validation Set Performance:
|
| 46 |
|
| 47 |
+
| Metric | Score |
|
| 48 |
+
|---------------------|-------|
|
| 49 |
+
| SARI | 89.68 |
|
| 50 |
+
| SARI Penalized | 88.42 |
|
| 51 |
+
| ROUGE-1 | 93.05 |
|
| 52 |
+
| ROUGE-2 | 88.47 |
|
| 53 |
+
| ROUGE-L | 92.98 |
|
|
|
|
|
|
|
| 54 |
|
| 55 |
### Test Set Performance:
|
| 56 |
|
|
|
|
| 64 |
|
| 65 |
ROUGE-L: 93.07
|
| 66 |
|
| 67 |
+
---
|
| 68 |
### Training Loss Curve
|
| 69 |
|
| 70 |
The loss curves during training are visualized in bart-large-sentence-compression_loss.eps, showing both training and evaluation loss over steps.
|