leonvanbokhorst commited on
Commit
012d799
·
verified ·
1 Parent(s): 38a4b85

Model save

Browse files
Files changed (1) hide show
  1. README.md +9 -6
README.md CHANGED
@@ -20,8 +20,8 @@ should probably proofread and complete it, then remove this comment. -->
20
 
21
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on the emotion dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 1.0773
24
- - Accuracy: 0.594
25
 
26
  ## Model description
27
 
@@ -40,20 +40,23 @@ More information needed
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
- - learning_rate: 5e-05
44
  - train_batch_size: 32
45
  - eval_batch_size: 32
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
- - num_epochs: 2
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
55
- | 2.3952 | 1.0 | 500 | 1.2924 | 0.537 |
56
- | 1.2039 | 2.0 | 1000 | 1.0773 | 0.594 |
 
 
 
57
 
58
 
59
  ### Framework versions
 
20
 
21
  This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on the emotion dataset.
22
  It achieves the following results on the evaluation set:
23
+ - Loss: 0.1321
24
+ - Accuracy: 0.937
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 0.0005
44
  - train_batch_size: 32
45
  - eval_batch_size: 32
46
  - seed: 42
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
  - lr_scheduler_type: linear
49
+ - num_epochs: 5
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
55
+ | 0.6485 | 1.0 | 500 | 0.2474 | 0.914 |
56
+ | 0.2247 | 2.0 | 1000 | 0.1730 | 0.9285 |
57
+ | 0.1752 | 3.0 | 1500 | 0.1544 | 0.9265 |
58
+ | 0.1479 | 4.0 | 2000 | 0.1401 | 0.9345 |
59
+ | 0.1336 | 5.0 | 2500 | 0.1321 | 0.937 |
60
 
61
 
62
  ### Framework versions