shahin-as commited on
Commit
0ea0d7f
·
verified ·
1 Parent(s): 067fa75

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +55 -0
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ## Fine-Tuned BART-Large for Sentence Compression
2
+
3
+ ### Model Overview
4
+
5
+ This model is a fine-tuned version of ```facebook/bart-large``` trained on the ```sentence-transformers/sentence-compression``` dataset. The goal of this model is to generate compressed versions of input sentences while maintaining fluency and meaning.
6
+
7
+ ### Training Details
8
+
9
+ Base Model: ```facebook/bart-large```
10
+
11
+ Dataset: ```sentence-transformers/sentence-compression```
12
+
13
+ Batch Size: 8
14
+
15
+ Epochs: 5
16
+
17
+ Learning Rate: 2e-5
18
+
19
+ Weight Decay: 0.01
20
+
21
+ Evaluation Metric for Best Model: SARI Penalized
22
+
23
+ Precision Mode: FP16 for efficient training
24
+
25
+ ### Evaluation Results
26
+
27
+ ### Validation Set Performance:
28
+
29
+ SARI: 89.68
30
+
31
+ SARI Penalized: 88.42
32
+
33
+ ROUGE-1: 93.05
34
+
35
+ ROUGE-2: 88.47
36
+
37
+ ROUGE-L: 92.98
38
+
39
+ ### Test Set Performance:
40
+
41
+ SARI: 89.76
42
+
43
+ SARI Penalized: 88.32
44
+
45
+ ROUGE-1: 93.14
46
+
47
+ ROUGE-2: 88.65
48
+
49
+ ROUGE-L: 93.07
50
+
51
+ ### Training Loss Curve
52
+
53
+ The loss curves during training are visualized in bart-large-sentence-compression_loss.eps, showing both training and evaluation loss over steps.
54
+
55
+