ashdev01 commited on
Commit
1c8d0c6
·
verified ·
1 Parent(s): 69ae8ea

End of training

Browse files
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
- base_model: distilbert/distilroberta-base
3
  license: apache-2.0
 
4
  tags:
5
  - generated_from_trainer
6
  model-index:
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [distilbert/distilroberta-base](https://huggingface.co/distilbert/distilroberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 1.5384
19
 
20
  ## Model description
21
 
@@ -34,21 +34,33 @@ More information needed
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
  - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
- - num_epochs: 3
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
- | 2.0781 | 1.0 | 2079 | 1.8743 |
50
- | 1.7808 | 2.0 | 4158 | 1.6253 |
51
- | 1.6776 | 3.0 | 6237 | 1.5384 |
 
 
 
 
 
 
 
 
 
 
 
 
52
 
53
 
54
  ### Framework versions
 
1
  ---
 
2
  license: apache-2.0
3
+ base_model: distilbert/distilroberta-base
4
  tags:
5
  - generated_from_trainer
6
  model-index:
 
15
 
16
  This model is a fine-tuned version of [distilbert/distilroberta-base](https://huggingface.co/distilbert/distilroberta-base) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.9088
19
 
20
  ## Model description
21
 
 
34
  ### Training hyperparameters
35
 
36
  The following hyperparameters were used during training:
37
+ - learning_rate: 0.0005
38
  - train_batch_size: 8
39
  - eval_batch_size: 8
40
  - seed: 42
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
  - lr_scheduler_type: linear
43
+ - num_epochs: 15
44
 
45
  ### Training results
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | No log | 1.0 | 199 | 1.7154 |
50
+ | No log | 2.0 | 398 | 1.5037 |
51
+ | 1.9788 | 3.0 | 597 | 1.3993 |
52
+ | 1.9788 | 4.0 | 796 | 1.3026 |
53
+ | 1.9788 | 5.0 | 995 | 1.2332 |
54
+ | 1.3929 | 6.0 | 1194 | 1.1941 |
55
+ | 1.3929 | 7.0 | 1393 | 1.1367 |
56
+ | 1.1697 | 8.0 | 1592 | 1.1049 |
57
+ | 1.1697 | 9.0 | 1791 | 1.0715 |
58
+ | 1.1697 | 10.0 | 1990 | 1.0183 |
59
+ | 1.0298 | 11.0 | 2189 | 1.0175 |
60
+ | 1.0298 | 12.0 | 2388 | 0.9541 |
61
+ | 0.9012 | 13.0 | 2587 | 0.9291 |
62
+ | 0.9012 | 14.0 | 2786 | 0.8999 |
63
+ | 0.9012 | 15.0 | 2985 | 0.9088 |
64
 
65
 
66
  ### Framework versions
runs/Jul16_06-47-48_f271b1b1ad67/events.out.tfevents.1721112469.f271b1b1ad67.231.6 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6f0e10ebdb2b98a6267341b1922360578ee534abebea313ee701f9fb4a9e419c
3
- size 9673
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:64a806fd30ee6cbc36ca7974c6388355dd490fd9d0512316b82aa01dd2c0950d
3
+ size 10298