File size: 23,170 Bytes
832ec16
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
---

library_name: transformers
license: apache-2.0
base_model: google-t5/t5-small
tags:
- generated_from_trainer
model-index:
- name: ptsd-summarization
  results: []
---


<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# ptsd-summarization

This model is a fine-tuned version of [google-t5/t5-small](https://huggingface.co/google-t5/t5-small) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.1631

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05

- train_batch_size: 1

- eval_batch_size: 1

- seed: 42

- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments

- lr_scheduler_type: linear

- num_epochs: 40
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch   | Step  | Validation Loss |
|:-------------:|:-------:|:-----:|:---------------:|
| 1.9664        | 0.1012  | 200   | 1.6373          |
| 1.8479        | 0.2023  | 400   | 1.5448          |
| 1.7346        | 0.3035  | 600   | 1.4981          |
| 1.6646        | 0.4047  | 800   | 1.4699          |
| 1.7652        | 0.5058  | 1000  | 1.4416          |
| 1.6482        | 0.6070  | 1200  | 1.4232          |
| 1.6232        | 0.7081  | 1400  | 1.4059          |
| 1.6663        | 0.8093  | 1600  | 1.3927          |
| 1.6392        | 0.9105  | 1800  | 1.3796          |
| 1.5706        | 1.0116  | 2000  | 1.3685          |
| 1.5516        | 1.1128  | 2200  | 1.3630          |
| 1.4989        | 1.2140  | 2400  | 1.3545          |
| 1.5427        | 1.3151  | 2600  | 1.3473          |
| 1.5742        | 1.4163  | 2800  | 1.3387          |
| 1.4773        | 1.5175  | 3000  | 1.3315          |
| 1.5533        | 1.6186  | 3200  | 1.3202          |
| 1.522         | 1.7198  | 3400  | 1.3174          |
| 1.5131        | 1.8209  | 3600  | 1.3203          |
| 1.4758        | 1.9221  | 3800  | 1.3039          |
| 1.5195        | 2.0233  | 4000  | 1.2988          |
| 1.4134        | 2.1244  | 4200  | 1.3007          |
| 1.4578        | 2.2256  | 4400  | 1.2943          |
| 1.4839        | 2.3268  | 4600  | 1.2922          |
| 1.3859        | 2.4279  | 4800  | 1.2835          |
| 1.4397        | 2.5291  | 5000  | 1.2839          |
| 1.4392        | 2.6302  | 5200  | 1.2808          |
| 1.4348        | 2.7314  | 5400  | 1.2685          |
| 1.4376        | 2.8326  | 5600  | 1.2679          |
| 1.4433        | 2.9337  | 5800  | 1.2665          |
| 1.4712        | 3.0349  | 6000  | 1.2667          |
| 1.4009        | 3.1361  | 6200  | 1.2630          |
| 1.3355        | 3.2372  | 6400  | 1.2591          |
| 1.3932        | 3.3384  | 6600  | 1.2566          |
| 1.3751        | 3.4396  | 6800  | 1.2533          |
| 1.3201        | 3.5407  | 7000  | 1.2550          |
| 1.3698        | 3.6419  | 7200  | 1.2506          |
| 1.4137        | 3.7430  | 7400  | 1.2452          |
| 1.3821        | 3.8442  | 7600  | 1.2469          |
| 1.3258        | 3.9454  | 7800  | 1.2427          |
| 1.3382        | 4.0465  | 8000  | 1.2419          |
| 1.3297        | 4.1477  | 8200  | 1.2391          |
| 1.3575        | 4.2489  | 8400  | 1.2308          |
| 1.3013        | 4.3500  | 8600  | 1.2277          |
| 1.3181        | 4.4512  | 8800  | 1.2261          |
| 1.3194        | 4.5524  | 9000  | 1.2272          |
| 1.3027        | 4.6535  | 9200  | 1.2310          |
| 1.3017        | 4.7547  | 9400  | 1.2242          |
| 1.3105        | 4.8558  | 9600  | 1.2269          |
| 1.3222        | 4.9570  | 9800  | 1.2163          |
| 1.309         | 5.0582  | 10000 | 1.2171          |
| 1.2944        | 5.1593  | 10200 | 1.2078          |
| 1.2968        | 5.2605  | 10400 | 1.2102          |
| 1.2824        | 5.3617  | 10600 | 1.2115          |
| 1.2581        | 5.4628  | 10800 | 1.2173          |
| 1.2682        | 5.5640  | 11000 | 1.2124          |
| 1.2704        | 5.6651  | 11200 | 1.2126          |
| 1.2858        | 5.7663  | 11400 | 1.2036          |
| 1.2483        | 5.8675  | 11600 | 1.2090          |
| 1.3131        | 5.9686  | 11800 | 1.2041          |
| 1.2148        | 6.0698  | 12000 | 1.2006          |
| 1.2455        | 6.1710  | 12200 | 1.2046          |
| 1.2568        | 6.2721  | 12400 | 1.2053          |
| 1.2171        | 6.3733  | 12600 | 1.2013          |
| 1.2149        | 6.4745  | 12800 | 1.1979          |
| 1.2106        | 6.5756  | 13000 | 1.2003          |
| 1.244         | 6.6768  | 13200 | 1.1933          |
| 1.246         | 6.7779  | 13400 | 1.1920          |
| 1.2931        | 6.8791  | 13600 | 1.1925          |
| 1.1615        | 6.9803  | 13800 | 1.1913          |
| 1.2136        | 7.0814  | 14000 | 1.1914          |
| 1.1436        | 7.1826  | 14200 | 1.1939          |
| 1.2137        | 7.2838  | 14400 | 1.1911          |
| 1.1871        | 7.3849  | 14600 | 1.1886          |
| 1.2506        | 7.4861  | 14800 | 1.1831          |
| 1.1921        | 7.5873  | 15000 | 1.1833          |
| 1.2177        | 7.6884  | 15200 | 1.1799          |
| 1.1888        | 7.7896  | 15400 | 1.1817          |
| 1.1947        | 7.8907  | 15600 | 1.1792          |
| 1.1784        | 7.9919  | 15800 | 1.1797          |
| 1.2106        | 8.0931  | 16000 | 1.1794          |
| 1.2427        | 8.1942  | 16200 | 1.1768          |
| 1.1888        | 8.2954  | 16400 | 1.1817          |
| 1.1271        | 8.3966  | 16600 | 1.1811          |
| 1.1584        | 8.4977  | 16800 | 1.1743          |
| 1.1506        | 8.5989  | 17000 | 1.1764          |
| 1.146         | 8.7001  | 17200 | 1.1761          |
| 1.1299        | 8.8012  | 17400 | 1.1750          |
| 1.1653        | 8.9024  | 17600 | 1.1704          |
| 1.1112        | 9.0035  | 17800 | 1.1681          |
| 1.1845        | 9.1047  | 18000 | 1.1687          |
| 1.135         | 9.2059  | 18200 | 1.1721          |
| 1.111         | 9.3070  | 18400 | 1.1666          |
| 1.1325        | 9.4082  | 18600 | 1.1662          |
| 1.1284        | 9.5094  | 18800 | 1.1671          |
| 1.0956        | 9.6105  | 19000 | 1.1754          |
| 1.1614        | 9.7117  | 19200 | 1.1707          |
| 1.1138        | 9.8128  | 19400 | 1.1686          |
| 1.1287        | 9.9140  | 19600 | 1.1709          |
| 1.134         | 10.0152 | 19800 | 1.1694          |
| 1.1109        | 10.1163 | 20000 | 1.1700          |
| 1.1186        | 10.2175 | 20200 | 1.1684          |
| 1.1232        | 10.3187 | 20400 | 1.1698          |
| 1.1287        | 10.4198 | 20600 | 1.1702          |
| 1.1139        | 10.5210 | 20800 | 1.1718          |
| 1.1484        | 10.6222 | 21000 | 1.1710          |
| 1.072         | 10.7233 | 21200 | 1.1639          |
| 1.0957        | 10.8245 | 21400 | 1.1611          |
| 1.128         | 10.9256 | 21600 | 1.1640          |
| 1.0693        | 11.0268 | 21800 | 1.1590          |
| 1.0505        | 11.1280 | 22000 | 1.1619          |
| 1.0466        | 11.2291 | 22200 | 1.1654          |
| 1.079         | 11.3303 | 22400 | 1.1631          |
| 1.1081        | 11.4315 | 22600 | 1.1615          |
| 1.0918        | 11.5326 | 22800 | 1.1593          |
| 1.092         | 11.6338 | 23000 | 1.1579          |
| 1.1203        | 11.7350 | 23200 | 1.1609          |
| 1.0742        | 11.8361 | 23400 | 1.1551          |
| 1.067         | 11.9373 | 23600 | 1.1557          |
| 1.0514        | 12.0384 | 23800 | 1.1635          |
| 1.0464        | 12.1396 | 24000 | 1.1600          |
| 1.0569        | 12.2408 | 24200 | 1.1602          |
| 1.0431        | 12.3419 | 24400 | 1.1612          |
| 1.0772        | 12.4431 | 24600 | 1.1628          |
| 1.0517        | 12.5443 | 24800 | 1.1578          |
| 1.0648        | 12.6454 | 25000 | 1.1577          |
| 1.0513        | 12.7466 | 25200 | 1.1621          |
| 1.0594        | 12.8477 | 25400 | 1.1592          |
| 1.0768        | 12.9489 | 25600 | 1.1604          |
| 1.1028        | 13.0501 | 25800 | 1.1500          |
| 1.0269        | 13.1512 | 26000 | 1.1566          |
| 1.0388        | 13.2524 | 26200 | 1.1595          |
| 0.9966        | 13.3536 | 26400 | 1.1595          |
| 1.0287        | 13.4547 | 26600 | 1.1604          |
| 1.0528        | 13.5559 | 26800 | 1.1565          |
| 1.0425        | 13.6571 | 27000 | 1.1536          |
| 1.0547        | 13.7582 | 27200 | 1.1567          |
| 1.0125        | 13.8594 | 27400 | 1.1606          |
| 1.0743        | 13.9605 | 27600 | 1.1513          |
| 0.9734        | 14.0617 | 27800 | 1.1579          |
| 1.0261        | 14.1629 | 28000 | 1.1528          |
| 1.0001        | 14.2640 | 28200 | 1.1584          |
| 1.014         | 14.3652 | 28400 | 1.1596          |
| 1.0252        | 14.4664 | 28600 | 1.1622          |
| 1.0505        | 14.5675 | 28800 | 1.1538          |
| 1.0142        | 14.6687 | 29000 | 1.1567          |
| 1.0291        | 14.7699 | 29200 | 1.1515          |
| 1.0313        | 14.8710 | 29400 | 1.1550          |
| 0.9889        | 14.9722 | 29600 | 1.1554          |
| 1.0173        | 15.0733 | 29800 | 1.1588          |
| 1.0081        | 15.1745 | 30000 | 1.1587          |
| 0.9559        | 15.2757 | 30200 | 1.1539          |
| 1.0332        | 15.3768 | 30400 | 1.1573          |
| 1.0004        | 15.4780 | 30600 | 1.1553          |
| 0.9586        | 15.5792 | 30800 | 1.1496          |
| 1.0138        | 15.6803 | 31000 | 1.1513          |
| 1.0256        | 15.7815 | 31200 | 1.1545          |
| 1.0243        | 15.8827 | 31400 | 1.1546          |
| 1.0135        | 15.9838 | 31600 | 1.1540          |
| 0.9589        | 16.0850 | 31800 | 1.1524          |
| 0.9672        | 16.1861 | 32000 | 1.1574          |
| 1.0335        | 16.2873 | 32200 | 1.1539          |
| 0.9464        | 16.3885 | 32400 | 1.1637          |
| 0.9669        | 16.4896 | 32600 | 1.1579          |
| 0.9629        | 16.5908 | 32800 | 1.1611          |
| 0.9586        | 16.6920 | 33000 | 1.1575          |
| 0.9939        | 16.7931 | 33200 | 1.1582          |
| 0.9956        | 16.8943 | 33400 | 1.1544          |
| 1.0249        | 16.9954 | 33600 | 1.1520          |
| 0.9461        | 17.0966 | 33800 | 1.1541          |
| 0.9876        | 17.1978 | 34000 | 1.1520          |
| 0.9656        | 17.2989 | 34200 | 1.1530          |
| 0.9443        | 17.4001 | 34400 | 1.1565          |
| 0.9348        | 17.5013 | 34600 | 1.1570          |
| 0.9906        | 17.6024 | 34800 | 1.1532          |
| 0.9281        | 17.7036 | 35000 | 1.1553          |
| 0.9346        | 17.8048 | 35200 | 1.1542          |
| 1.0175        | 17.9059 | 35400 | 1.1506          |
| 0.9547        | 18.0071 | 35600 | 1.1544          |
| 0.9089        | 18.1082 | 35800 | 1.1571          |
| 0.9506        | 18.2094 | 36000 | 1.1559          |
| 0.9625        | 18.3106 | 36200 | 1.1532          |
| 0.9206        | 18.4117 | 36400 | 1.1532          |
| 0.8997        | 18.5129 | 36600 | 1.1530          |
| 0.9625        | 18.6141 | 36800 | 1.1553          |
| 0.9358        | 18.7152 | 37000 | 1.1516          |
| 1.0168        | 18.8164 | 37200 | 1.1531          |
| 0.965         | 18.9176 | 37400 | 1.1489          |
| 0.9527        | 19.0187 | 37600 | 1.1463          |
| 0.9437        | 19.1199 | 37800 | 1.1511          |
| 0.916         | 19.2210 | 38000 | 1.1523          |
| 0.9264        | 19.3222 | 38200 | 1.1521          |
| 0.957         | 19.4234 | 38400 | 1.1507          |
| 0.9539        | 19.5245 | 38600 | 1.1533          |
| 0.9256        | 19.6257 | 38800 | 1.1498          |
| 0.908         | 19.7269 | 39000 | 1.1497          |
| 0.8984        | 19.8280 | 39200 | 1.1525          |
| 0.9754        | 19.9292 | 39400 | 1.1479          |
| 0.9266        | 20.0303 | 39600 | 1.1521          |
| 0.942         | 20.1315 | 39800 | 1.1513          |
| 0.9249        | 20.2327 | 40000 | 1.1485          |
| 0.8982        | 20.3338 | 40200 | 1.1505          |
| 0.8932        | 20.4350 | 40400 | 1.1541          |
| 0.926         | 20.5362 | 40600 | 1.1554          |
| 0.9393        | 20.6373 | 40800 | 1.1538          |
| 0.9498        | 20.7385 | 41000 | 1.1513          |
| 0.9262        | 20.8397 | 41200 | 1.1546          |
| 0.9085        | 20.9408 | 41400 | 1.1519          |
| 0.924         | 21.0420 | 41600 | 1.1526          |
| 0.8869        | 21.1431 | 41800 | 1.1568          |
| 0.9009        | 21.2443 | 42000 | 1.1549          |
| 0.9097        | 21.3455 | 42200 | 1.1505          |
| 0.9179        | 21.4466 | 42400 | 1.1495          |
| 0.9519        | 21.5478 | 42600 | 1.1492          |
| 0.9473        | 21.6490 | 42800 | 1.1480          |
| 0.9488        | 21.7501 | 43000 | 1.1521          |
| 0.8719        | 21.8513 | 43200 | 1.1501          |
| 0.8593        | 21.9525 | 43400 | 1.1544          |
| 0.9029        | 22.0536 | 43600 | 1.1572          |
| 0.9005        | 22.1548 | 43800 | 1.1532          |
| 0.919         | 22.2559 | 44000 | 1.1521          |
| 0.9448        | 22.3571 | 44200 | 1.1506          |
| 0.9157        | 22.4583 | 44400 | 1.1575          |
| 0.8985        | 22.5594 | 44600 | 1.1528          |
| 0.8632        | 22.6606 | 44800 | 1.1571          |
| 0.8519        | 22.7618 | 45000 | 1.1521          |
| 0.8813        | 22.8629 | 45200 | 1.1543          |
| 0.9135        | 22.9641 | 45400 | 1.1524          |
| 0.9258        | 23.0653 | 45600 | 1.1533          |
| 0.8879        | 23.1664 | 45800 | 1.1509          |
| 0.8898        | 23.2676 | 46000 | 1.1557          |
| 0.8521        | 23.3687 | 46200 | 1.1578          |
| 0.8519        | 23.4699 | 46400 | 1.1574          |
| 0.9005        | 23.5711 | 46600 | 1.1552          |
| 0.8927        | 23.6722 | 46800 | 1.1534          |
| 0.8729        | 23.7734 | 47000 | 1.1565          |
| 0.9021        | 23.8746 | 47200 | 1.1533          |
| 0.9276        | 23.9757 | 47400 | 1.1560          |
| 0.8924        | 24.0769 | 47600 | 1.1545          |
| 0.8545        | 24.1780 | 47800 | 1.1525          |
| 0.8724        | 24.2792 | 48000 | 1.1501          |
| 0.9042        | 24.3804 | 48200 | 1.1554          |
| 0.9064        | 24.4815 | 48400 | 1.1523          |
| 0.8832        | 24.5827 | 48600 | 1.1512          |
| 0.8979        | 24.6839 | 48800 | 1.1532          |
| 0.8324        | 24.7850 | 49000 | 1.1528          |
| 0.8757        | 24.8862 | 49200 | 1.1550          |
| 0.8614        | 24.9874 | 49400 | 1.1545          |
| 0.8691        | 25.0885 | 49600 | 1.1545          |
| 0.8828        | 25.1897 | 49800 | 1.1557          |
| 0.8455        | 25.2908 | 50000 | 1.1565          |
| 0.8352        | 25.3920 | 50200 | 1.1526          |
| 0.8775        | 25.4932 | 50400 | 1.1527          |
| 0.832         | 25.5943 | 50600 | 1.1562          |
| 0.9212        | 25.6955 | 50800 | 1.1560          |
| 0.8921        | 25.7967 | 51000 | 1.1520          |
| 0.8611        | 25.8978 | 51200 | 1.1531          |
| 0.8633        | 25.9990 | 51400 | 1.1522          |
| 0.8508        | 26.1002 | 51600 | 1.1541          |
| 0.823         | 26.2013 | 51800 | 1.1550          |
| 0.9097        | 26.3025 | 52000 | 1.1558          |
| 0.8726        | 26.4036 | 52200 | 1.1537          |
| 0.8891        | 26.5048 | 52400 | 1.1545          |
| 0.8276        | 26.6060 | 52600 | 1.1559          |
| 0.8404        | 26.7071 | 52800 | 1.1543          |
| 0.8556        | 26.8083 | 53000 | 1.1510          |
| 0.8846        | 26.9095 | 53200 | 1.1544          |
| 0.8461        | 27.0106 | 53400 | 1.1533          |
| 0.8265        | 27.1118 | 53600 | 1.1516          |
| 0.8807        | 27.2129 | 53800 | 1.1529          |
| 0.8459        | 27.3141 | 54000 | 1.1554          |
| 0.8648        | 27.4153 | 54200 | 1.1556          |
| 0.8559        | 27.5164 | 54400 | 1.1592          |
| 0.8797        | 27.6176 | 54600 | 1.1546          |
| 0.8502        | 27.7188 | 54800 | 1.1565          |
| 0.83          | 27.8199 | 55000 | 1.1568          |
| 0.863         | 27.9211 | 55200 | 1.1582          |
| 0.8294        | 28.0223 | 55400 | 1.1564          |
| 0.8217        | 28.1234 | 55600 | 1.1565          |
| 0.8321        | 28.2246 | 55800 | 1.1568          |
| 0.8231        | 28.3257 | 56000 | 1.1559          |
| 0.8355        | 28.4269 | 56200 | 1.1539          |
| 0.8347        | 28.5281 | 56400 | 1.1546          |
| 0.8538        | 28.6292 | 56600 | 1.1555          |
| 0.8558        | 28.7304 | 56800 | 1.1572          |
| 0.8243        | 28.8316 | 57000 | 1.1576          |
| 0.9286        | 28.9327 | 57200 | 1.1575          |
| 0.8884        | 29.0339 | 57400 | 1.1558          |
| 0.8399        | 29.1351 | 57600 | 1.1578          |
| 0.8306        | 29.2362 | 57800 | 1.1567          |
| 0.8208        | 29.3374 | 58000 | 1.1566          |
| 0.8072        | 29.4385 | 58200 | 1.1585          |
| 0.8278        | 29.5397 | 58400 | 1.1591          |
| 0.8489        | 29.6409 | 58600 | 1.1579          |
| 0.8756        | 29.7420 | 58800 | 1.1542          |
| 0.8384        | 29.8432 | 59000 | 1.1560          |
| 0.8134        | 29.9444 | 59200 | 1.1584          |
| 0.8215        | 30.0455 | 59400 | 1.1604          |
| 0.8562        | 30.1467 | 59600 | 1.1584          |
| 0.8449        | 30.2479 | 59800 | 1.1612          |
| 0.8796        | 30.3490 | 60000 | 1.1585          |
| 0.9045        | 30.4502 | 60200 | 1.1548          |
| 0.7957        | 30.5513 | 60400 | 1.1574          |
| 0.7785        | 30.6525 | 60600 | 1.1571          |
| 0.8368        | 30.7537 | 60800 | 1.1592          |
| 0.8423        | 30.8548 | 61000 | 1.1588          |
| 0.7635        | 30.9560 | 61200 | 1.1597          |
| 0.8168        | 31.0572 | 61400 | 1.1588          |
| 0.8612        | 31.1583 | 61600 | 1.1590          |
| 0.83          | 31.2595 | 61800 | 1.1591          |
| 0.8217        | 31.3606 | 62000 | 1.1577          |
| 0.8413        | 31.4618 | 62200 | 1.1560          |
| 0.8382        | 31.5630 | 62400 | 1.1579          |
| 0.804         | 31.6641 | 62600 | 1.1590          |
| 0.8481        | 31.7653 | 62800 | 1.1586          |
| 0.8373        | 31.8665 | 63000 | 1.1577          |
| 0.778         | 31.9676 | 63200 | 1.1590          |
| 0.8349        | 32.0688 | 63400 | 1.1605          |
| 0.7616        | 32.1700 | 63600 | 1.1588          |
| 0.8354        | 32.2711 | 63800 | 1.1600          |
| 0.8107        | 32.3723 | 64000 | 1.1595          |
| 0.8092        | 32.4734 | 64200 | 1.1605          |
| 0.808         | 32.5746 | 64400 | 1.1596          |
| 0.8734        | 32.6758 | 64600 | 1.1586          |
| 0.806         | 32.7769 | 64800 | 1.1589          |
| 0.7934        | 32.8781 | 65000 | 1.1579          |
| 0.924         | 32.9793 | 65200 | 1.1592          |
| 0.8016        | 33.0804 | 65400 | 1.1600          |
| 0.8136        | 33.1816 | 65600 | 1.1608          |
| 0.8735        | 33.2828 | 65800 | 1.1603          |
| 0.8068        | 33.3839 | 66000 | 1.1602          |
| 0.8051        | 33.4851 | 66200 | 1.1618          |
| 0.8049        | 33.5862 | 66400 | 1.1623          |
| 0.8062        | 33.6874 | 66600 | 1.1621          |
| 0.7888        | 33.7886 | 66800 | 1.1636          |
| 0.8115        | 33.8897 | 67000 | 1.1653          |
| 0.8149        | 33.9909 | 67200 | 1.1639          |
| 0.7969        | 34.0921 | 67400 | 1.1621          |
| 0.8319        | 34.1932 | 67600 | 1.1621          |
| 0.8           | 34.2944 | 67800 | 1.1613          |
| 0.8332        | 34.3955 | 68000 | 1.1610          |
| 0.802         | 34.4967 | 68200 | 1.1601          |
| 0.8242        | 34.5979 | 68400 | 1.1618          |
| 0.7646        | 34.6990 | 68600 | 1.1634          |
| 0.7749        | 34.8002 | 68800 | 1.1634          |
| 0.8498        | 34.9014 | 69000 | 1.1619          |
| 0.8597        | 35.0025 | 69200 | 1.1619          |
| 0.8015        | 35.1037 | 69400 | 1.1607          |
| 0.8733        | 35.2049 | 69600 | 1.1604          |
| 0.8199        | 35.3060 | 69800 | 1.1621          |
| 0.7654        | 35.4072 | 70000 | 1.1626          |
| 0.7932        | 35.5083 | 70200 | 1.1628          |
| 0.8133        | 35.6095 | 70400 | 1.1611          |
| 0.7802        | 35.7107 | 70600 | 1.1612          |
| 0.8061        | 35.8118 | 70800 | 1.1604          |
| 0.7915        | 35.9130 | 71000 | 1.1610          |
| 0.8092        | 36.0142 | 71200 | 1.1619          |
| 0.7976        | 36.1153 | 71400 | 1.1627          |
| 0.8017        | 36.2165 | 71600 | 1.1627          |
| 0.79          | 36.3177 | 71800 | 1.1628          |
| 0.7558        | 36.4188 | 72000 | 1.1627          |
| 0.7938        | 36.5200 | 72200 | 1.1628          |
| 0.8048        | 36.6211 | 72400 | 1.1624          |
| 0.8593        | 36.7223 | 72600 | 1.1630          |
| 0.8314        | 36.8235 | 72800 | 1.1629          |
| 0.8283        | 36.9246 | 73000 | 1.1614          |
| 0.8174        | 37.0258 | 73200 | 1.1609          |
| 0.7722        | 37.1270 | 73400 | 1.1608          |
| 0.749         | 37.2281 | 73600 | 1.1611          |
| 0.7754        | 37.3293 | 73800 | 1.1607          |
| 0.781         | 37.4305 | 74000 | 1.1617          |
| 0.8335        | 37.5316 | 74200 | 1.1623          |
| 0.8072        | 37.6328 | 74400 | 1.1633          |
| 0.8042        | 37.7339 | 74600 | 1.1630          |
| 0.8393        | 37.8351 | 74800 | 1.1633          |
| 0.829         | 37.9363 | 75000 | 1.1627          |
| 0.8514        | 38.0374 | 75200 | 1.1626          |
| 0.7967        | 38.1386 | 75400 | 1.1632          |
| 0.7447        | 38.2398 | 75600 | 1.1634          |
| 0.78          | 38.3409 | 75800 | 1.1641          |
| 0.8281        | 38.4421 | 76000 | 1.1635          |
| 0.8021        | 38.5432 | 76200 | 1.1633          |
| 0.8328        | 38.6444 | 76400 | 1.1629          |
| 0.8464        | 38.7456 | 76600 | 1.1629          |
| 0.837         | 38.8467 | 76800 | 1.1625          |
| 0.7686        | 38.9479 | 77000 | 1.1627          |
| 0.8235        | 39.0491 | 77200 | 1.1625          |
| 0.8161        | 39.1502 | 77400 | 1.1626          |
| 0.8016        | 39.2514 | 77600 | 1.1627          |
| 0.7946        | 39.3526 | 77800 | 1.1630          |
| 0.7941        | 39.4537 | 78000 | 1.1633          |
| 0.76          | 39.5549 | 78200 | 1.1632          |
| 0.8394        | 39.6560 | 78400 | 1.1632          |
| 0.7558        | 39.7572 | 78600 | 1.1632          |
| 0.8374        | 39.8584 | 78800 | 1.1631          |
| 0.8077        | 39.9595 | 79000 | 1.1631          |


### Framework versions

- Transformers 4.48.0
- Pytorch 2.5.1+cu124
- Datasets 3.3.0
- Tokenizers 0.21.0