File size: 6,956 Bytes
f2fa818 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 |
Training/evaluation parameters Namespace(data_dir='bias_toxic_truthful/toxic/', model_dir='/data/ryanyip/Text-Classifier', model_name='bert-base-cased', output_dir='checkpoints/ToxicClassifier', do_train=True, do_predict=False, result_output_dir='checkpoints/ToxicClassifier/result', max_length=128, train_batch_size=16, eval_batch_size=16, learning_rate=5e-05, weight_decay=0.01, adam_epsilon=1e-08, max_grad_norm=1.0, epochs=10, warmup_proportion=0.1, earlystop_patience=2, logging_steps=10, save_steps=5000, seed=2021, device=device(type='cuda'), model_type='bert', task_name='qic')
***** Running training *****
Num samples 79212
Num epochs 10
Num training steps 49510
Num warmup steps 4951
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.2161971119862668
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-10
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.21791376350600827
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-20
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.22003433303039482
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-30
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.2237705745733616
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-40
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.24012925376148642
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-50
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.27819852569928305
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-60
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.3636271836817126
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-70
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.5175199434514793
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-80
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.6735332727456327
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-90
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7494698576189034
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-100
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7759264869231546
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-110
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7842068060183782
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-120
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7872361910532162
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-130
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7874381500555387
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-140
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7877410885590225
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-150
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7877410885590225
Earlystopper counter: 1 out of 2
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7875391295567
Earlystopper counter: 2 out of 2
Training Stop! The best step 150: 0.7877410885590225
Saving models checkpoint to checkpoints/ToxicClassifier
Training/evaluation parameters Namespace(data_dir='bias_toxic_truthful/toxic/', model_dir='/data/ryanyip/Text-Classifier', model_name='bert-base-cased', output_dir='checkpoints/ToxicClassifier', do_train=True, do_predict=False, result_output_dir='checkpoints/ToxicClassifier/result', max_length=128, train_batch_size=32, eval_batch_size=16, learning_rate=5e-05, weight_decay=0.01, adam_epsilon=1e-08, max_grad_norm=1.0, epochs=20, warmup_proportion=0.1, earlystop_patience=2, logging_steps=100, save_steps=5000, seed=2021, device=device(type='cuda'), model_type='bert', task_name='qic')
***** Running training *****
Num samples 79212
Num epochs 20
Num training steps 49520
Num warmup steps 4952
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7775421589417348
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-100
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7878420680601838
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-200
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8174290619004342
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-300
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8627688579218419
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-400
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8869029586993841
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-500
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8974048268201555
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-600
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9020498838735737
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-700
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.906392002423508
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-800
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9112390184792487
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-900
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9129556699989902
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1000
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9129556699989902
Earlystopper counter: 1 out of 2
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9181056245582147
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1200
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9213369685953752
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1300
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9223467636069878
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1400
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9253761486418257
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1500
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9202261940826012
Earlystopper counter: 1 out of 2
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9241643946278906
Earlystopper counter: 2 out of 2
Training Stop! The best step 1500: 0.9253761486418257
Saving models checkpoint to checkpoints/ToxicClassifier
|