pszemraj commited on
Commit
5159c6c
·
1 Parent(s): 331ea20

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -28
README.md CHANGED
@@ -105,31 +105,3 @@ Final response in 1294.857 s:
105
 
106
  3. Somewhat related to #2 above, fixing/correcting so-called [tortured-phrases](https://arxiv.org/abs/2107.06751) that are dead giveaways text was generated by a language model. _Note that _SOME_ of these are not fixed, especially as they venture into domain-specific terminology (i.e. irregular timberland instead of Random Forest)._
107
 
108
-
109
- ## Training and evaluation data
110
-
111
- More information needed 😉
112
-
113
- ## Training procedure
114
-
115
- ### Training hyperparameters
116
-
117
- The following hyperparameters were used during training:
118
- - learning_rate: 8e-05
119
- - train_batch_size: 4
120
- - eval_batch_size: 1
121
- - seed: 42
122
- - distributed_type: multi-GPU
123
- - gradient_accumulation_steps: 32
124
- - total_train_batch_size: 128
125
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
126
- - lr_scheduler_type: cosine
127
- - lr_scheduler_warmup_ratio: 0.02
128
- - num_epochs: 1
129
-
130
- ### Framework versions
131
-
132
- - Transformers 4.20.1
133
- - Pytorch 1.11.0+cu113
134
- - Datasets 2.3.2
135
- - Tokenizers 0.12.1
 
105
 
106
  3. Somewhat related to #2 above, fixing/correcting so-called [tortured-phrases](https://arxiv.org/abs/2107.06751) that are dead giveaways text was generated by a language model. _Note that _SOME_ of these are not fixed, especially as they venture into domain-specific terminology (i.e. irregular timberland instead of Random Forest)._
107