Update README.md
Browse files
README.md
CHANGED
@@ -105,31 +105,3 @@ Final response in 1294.857 s:
|
|
105 |
|
106 |
3. Somewhat related to #2 above, fixing/correcting so-called [tortured-phrases](https://arxiv.org/abs/2107.06751) that are dead giveaways text was generated by a language model. _Note that _SOME_ of these are not fixed, especially as they venture into domain-specific terminology (i.e. irregular timberland instead of Random Forest)._
|
107 |
|
108 |
-
|
109 |
-
## Training and evaluation data
|
110 |
-
|
111 |
-
More information needed 😉
|
112 |
-
|
113 |
-
## Training procedure
|
114 |
-
|
115 |
-
### Training hyperparameters
|
116 |
-
|
117 |
-
The following hyperparameters were used during training:
|
118 |
-
- learning_rate: 8e-05
|
119 |
-
- train_batch_size: 4
|
120 |
-
- eval_batch_size: 1
|
121 |
-
- seed: 42
|
122 |
-
- distributed_type: multi-GPU
|
123 |
-
- gradient_accumulation_steps: 32
|
124 |
-
- total_train_batch_size: 128
|
125 |
-
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
126 |
-
- lr_scheduler_type: cosine
|
127 |
-
- lr_scheduler_warmup_ratio: 0.02
|
128 |
-
- num_epochs: 1
|
129 |
-
|
130 |
-
### Framework versions
|
131 |
-
|
132 |
-
- Transformers 4.20.1
|
133 |
-
- Pytorch 1.11.0+cu113
|
134 |
-
- Datasets 2.3.2
|
135 |
-
- Tokenizers 0.12.1
|
|
|
105 |
|
106 |
3. Somewhat related to #2 above, fixing/correcting so-called [tortured-phrases](https://arxiv.org/abs/2107.06751) that are dead giveaways text was generated by a language model. _Note that _SOME_ of these are not fixed, especially as they venture into domain-specific terminology (i.e. irregular timberland instead of Random Forest)._
|
107 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|