Upload README.md with huggingface_hub
Browse files
README.md
ADDED
@@ -0,0 +1,55 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
## Fine-Tuned BART-Large for Sentence Compression
|
2 |
+
|
3 |
+
### Model Overview
|
4 |
+
|
5 |
+
This model is a fine-tuned version of ```facebook/bart-large``` trained on the ```sentence-transformers/sentence-compression``` dataset. The goal of this model is to generate compressed versions of input sentences while maintaining fluency and meaning.
|
6 |
+
|
7 |
+
### Training Details
|
8 |
+
|
9 |
+
Base Model: ```facebook/bart-large```
|
10 |
+
|
11 |
+
Dataset: ```sentence-transformers/sentence-compression```
|
12 |
+
|
13 |
+
Batch Size: 8
|
14 |
+
|
15 |
+
Epochs: 5
|
16 |
+
|
17 |
+
Learning Rate: 2e-5
|
18 |
+
|
19 |
+
Weight Decay: 0.01
|
20 |
+
|
21 |
+
Evaluation Metric for Best Model: SARI Penalized
|
22 |
+
|
23 |
+
Precision Mode: FP16 for efficient training
|
24 |
+
|
25 |
+
### Evaluation Results
|
26 |
+
|
27 |
+
### Validation Set Performance:
|
28 |
+
|
29 |
+
SARI: 89.68
|
30 |
+
|
31 |
+
SARI Penalized: 88.42
|
32 |
+
|
33 |
+
ROUGE-1: 93.05
|
34 |
+
|
35 |
+
ROUGE-2: 88.47
|
36 |
+
|
37 |
+
ROUGE-L: 92.98
|
38 |
+
|
39 |
+
### Test Set Performance:
|
40 |
+
|
41 |
+
SARI: 89.76
|
42 |
+
|
43 |
+
SARI Penalized: 88.32
|
44 |
+
|
45 |
+
ROUGE-1: 93.14
|
46 |
+
|
47 |
+
ROUGE-2: 88.65
|
48 |
+
|
49 |
+
ROUGE-L: 93.07
|
50 |
+
|
51 |
+
### Training Loss Curve
|
52 |
+
|
53 |
+
The loss curves during training are visualized in bart-large-sentence-compression_loss.eps, showing both training and evaluation loss over steps.
|
54 |
+
|
55 |
+
|