leonvanbokhorst commited on
Commit
bbc1036
·
verified ·
1 Parent(s): 507290f

Model save

Browse files
Files changed (1) hide show
  1. README.md +15 -8
README.md CHANGED
@@ -6,6 +6,8 @@ tags:
6
  base_model: openai-community/gpt2
7
  datasets:
8
  - emotion
 
 
9
  model-index:
10
  - name: emotion-gpt2-lora
11
  results: []
@@ -18,13 +20,8 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on the emotion dataset.
20
  It achieves the following results on the evaluation set:
21
- - eval_loss: 0.1395
22
- - eval_accuracy: 0.9425
23
- - eval_runtime: 1.0543
24
- - eval_samples_per_second: 1897.017
25
- - eval_steps_per_second: 59.756
26
- - epoch: 4.0
27
- - step: 2000
28
 
29
  ## Model description
30
 
@@ -49,7 +46,17 @@ The following hyperparameters were used during training:
49
  - seed: 42
50
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
51
  - lr_scheduler_type: linear
52
- - num_epochs: 5
 
 
 
 
 
 
 
 
 
 
53
 
54
  ### Framework versions
55
 
 
6
  base_model: openai-community/gpt2
7
  datasets:
8
  - emotion
9
+ metrics:
10
+ - accuracy
11
  model-index:
12
  - name: emotion-gpt2-lora
13
  results: []
 
20
 
21
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on the emotion dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.1289
24
+ - Accuracy: 0.9315
 
 
 
 
 
25
 
26
  ## Model description
27
 
 
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
+ - num_epochs: 4
50
+
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|
55
+ | 0.6663 | 1.0 | 500 | 0.2313 | 0.9165 |
56
+ | 0.2324 | 2.0 | 1000 | 0.1677 | 0.928 |
57
+ | 0.1747 | 3.0 | 1500 | 0.1426 | 0.9355 |
58
+ | 0.1465 | 4.0 | 2000 | 0.1289 | 0.9315 |
59
+
60
 
61
  ### Framework versions
62