File size: 6,956 Bytes
f2fa818
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
Training/evaluation parameters Namespace(data_dir='bias_toxic_truthful/toxic/', model_dir='/data/ryanyip/Text-Classifier', model_name='bert-base-cased', output_dir='checkpoints/ToxicClassifier', do_train=True, do_predict=False, result_output_dir='checkpoints/ToxicClassifier/result', max_length=128, train_batch_size=16, eval_batch_size=16, learning_rate=5e-05, weight_decay=0.01, adam_epsilon=1e-08, max_grad_norm=1.0, epochs=10, warmup_proportion=0.1, earlystop_patience=2, logging_steps=10, save_steps=5000, seed=2021, device=device(type='cuda'), model_type='bert', task_name='qic')
***** Running training *****
Num samples 79212
Num epochs 10
Num training steps 49510
Num warmup steps 4951
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.2161971119862668
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-10
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.21791376350600827
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-20
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.22003433303039482
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-30
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.2237705745733616
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-40
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.24012925376148642
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-50
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.27819852569928305
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-60
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.3636271836817126
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-70
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.5175199434514793
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-80
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.6735332727456327
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-90
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7494698576189034
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-100
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7759264869231546
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-110
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7842068060183782
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-120
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7872361910532162
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-130
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7874381500555387
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-140
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7877410885590225
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-150
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7877410885590225
Earlystopper counter: 1 out of 2
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7875391295567
Earlystopper counter: 2 out of 2
Training Stop! The best step 150: 0.7877410885590225
Saving models checkpoint to checkpoints/ToxicClassifier
Training/evaluation parameters Namespace(data_dir='bias_toxic_truthful/toxic/', model_dir='/data/ryanyip/Text-Classifier', model_name='bert-base-cased', output_dir='checkpoints/ToxicClassifier', do_train=True, do_predict=False, result_output_dir='checkpoints/ToxicClassifier/result', max_length=128, train_batch_size=32, eval_batch_size=16, learning_rate=5e-05, weight_decay=0.01, adam_epsilon=1e-08, max_grad_norm=1.0, epochs=20, warmup_proportion=0.1, earlystop_patience=2, logging_steps=100, save_steps=5000, seed=2021, device=device(type='cuda'), model_type='bert', task_name='qic')
***** Running training *****
Num samples 79212
Num epochs 20
Num training steps 49520
Num warmup steps 4952
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7775421589417348
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-100
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.7878420680601838
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-200
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8174290619004342
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-300
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8627688579218419
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-400
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8869029586993841
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-500
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.8974048268201555
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-600
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9020498838735737
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-700
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.906392002423508
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-800
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9112390184792487
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-900
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9129556699989902
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1000
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9129556699989902
Earlystopper counter: 1 out of 2
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9181056245582147
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1200
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9213369685953752
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1300
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9223467636069878
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1400
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9253761486418257
Saving models checkpoint to checkpoints/ToxicClassifier/checkpoint-1500
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9202261940826012
Earlystopper counter: 1 out of 2
***** Running evaluation *****
Num samples 9903
qic-bert-base-cased acc: 0.9241643946278906
Earlystopper counter: 2 out of 2
Training Stop! The best step 1500: 0.9253761486418257
Saving models checkpoint to checkpoints/ToxicClassifier