affahrizain commited on
Commit
16c0e11
·
verified ·
1 Parent(s): 1ccf0b9

Model save

Browse files
Files changed (1) hide show
  1. README.md +4 -18
README.md CHANGED
@@ -3,8 +3,6 @@ license: mit
3
  base_model: indobenchmark/indogpt
4
  tags:
5
  - generated_from_trainer
6
- datasets:
7
- - id-review-gen
8
  model-index:
9
  - name: gpt2-finetune-id-review-gen
10
  results: []
@@ -15,9 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # gpt2-finetune-id-review-gen
17
 
18
- This model is a fine-tuned version of [indobenchmark/indogpt](https://huggingface.co/indobenchmark/indogpt) on the id-review-gen dataset.
19
- It achieves the following results on the evaluation set:
20
- - Loss: 3.7620
21
 
22
  ## Model description
23
 
@@ -37,23 +33,13 @@ More information needed
37
 
38
  The following hyperparameters were used during training:
39
  - learning_rate: 2e-05
40
- - train_batch_size: 4
41
- - eval_batch_size: 4
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
  - num_epochs: 5
46
-
47
- ### Training results
48
-
49
- | Training Loss | Epoch | Step | Validation Loss |
50
- |:-------------:|:-----:|:------:|:---------------:|
51
- | 3.9882 | 1.0 | 21065 | 3.7872 |
52
- | 3.6107 | 2.0 | 42130 | 3.7341 |
53
- | 3.3933 | 3.0 | 63195 | 3.7304 |
54
- | 3.2175 | 4.0 | 84260 | 3.7434 |
55
- | 3.0871 | 5.0 | 105325 | 3.7620 |
56
-
57
 
58
  ### Framework versions
59
 
 
3
  base_model: indobenchmark/indogpt
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: gpt2-finetune-id-review-gen
8
  results: []
 
13
 
14
  # gpt2-finetune-id-review-gen
15
 
16
+ This model is a fine-tuned version of [indobenchmark/indogpt](https://huggingface.co/indobenchmark/indogpt) on an unknown dataset.
 
 
17
 
18
  ## Model description
19
 
 
33
 
34
  The following hyperparameters were used during training:
35
  - learning_rate: 2e-05
36
+ - train_batch_size: 16
37
+ - eval_batch_size: 16
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
  - lr_scheduler_type: linear
41
  - num_epochs: 5
42
+ - mixed_precision_training: Native AMP
 
 
 
 
 
 
 
 
 
 
43
 
44
  ### Framework versions
45