File size: 36,794 Bytes
15c399a 612e869 15c399a 612e869 15c399a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 |
---
library_name: transformers
license: apache-2.0
base_model: facebook/detr-resnet-50
tags:
- object-detection
- vision
- generated_from_trainer
model-index:
- name: detr-finetuned-cppe-5-10k-steps
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# detr-finetuned-cppe-5-10k-steps
This model is a fine-tuned version of [facebook/detr-resnet-50](https://huggingface.co/facebook/detr-resnet-50) on the cppe-5 dataset.
It achieves the following results on the evaluation set:
- Loss: 1.2733
- Map: 0.2965
- Map 50: 0.5888
- Map 75: 0.2549
- Map Small: 0.085
- Map Medium: 0.2348
- Map Large: 0.4635
- Mar 1: 0.2926
- Mar 10: 0.4628
- Mar 100: 0.4771
- Mar Small: 0.1972
- Mar Medium: 0.4214
- Mar Large: 0.6518
- Map Coverall: 0.5413
- Mar 100 Coverall: 0.6838
- Map Face Shield: 0.2526
- Mar 100 Face Shield: 0.4696
- Map Gloves: 0.2117
- Mar 100 Gloves: 0.4036
- Map Goggles: 0.1686
- Mar 100 Goggles: 0.4169
- Map Mask: 0.3083
- Mar 100 Mask: 0.4116
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 1337
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 100.0
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Map | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1 | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Coverall | Mar 100 Coverall | Map Face Shield | Mar 100 Face Shield | Map Gloves | Mar 100 Gloves | Map Goggles | Mar 100 Goggles | Map Mask | Mar 100 Mask |
|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:------------:|:----------------:|:---------------:|:-------------------:|:----------:|:--------------:|:-----------:|:---------------:|:--------:|:------------:|
| 2.9916 | 1.0 | 107 | 2.3798 | 0.0207 | 0.0465 | 0.0156 | 0.0025 | 0.0171 | 0.0226 | 0.0542 | 0.1129 | 0.1459 | 0.045 | 0.1086 | 0.1896 | 0.0949 | 0.3703 | 0.0 | 0.0 | 0.0021 | 0.1455 | 0.0 | 0.0 | 0.0066 | 0.2138 |
| 2.1118 | 2.0 | 214 | 2.2127 | 0.0433 | 0.0992 | 0.0362 | 0.0069 | 0.0396 | 0.0488 | 0.0612 | 0.1542 | 0.184 | 0.0695 | 0.1388 | 0.2132 | 0.1884 | 0.5167 | 0.0 | 0.0 | 0.0055 | 0.1571 | 0.0 | 0.0 | 0.0227 | 0.2462 |
| 1.966 | 3.0 | 321 | 2.1864 | 0.0394 | 0.0956 | 0.0315 | 0.0141 | 0.0377 | 0.0469 | 0.057 | 0.1419 | 0.1702 | 0.0537 | 0.1194 | 0.2138 | 0.1491 | 0.4977 | 0.0 | 0.0 | 0.0111 | 0.1237 | 0.0 | 0.0 | 0.0369 | 0.2298 |
| 1.8256 | 4.0 | 428 | 2.1195 | 0.0703 | 0.1626 | 0.0496 | 0.0133 | 0.0516 | 0.0855 | 0.0861 | 0.1734 | 0.2015 | 0.0733 | 0.1527 | 0.2385 | 0.2673 | 0.5793 | 0.0 | 0.0 | 0.0275 | 0.1946 | 0.0 | 0.0 | 0.0567 | 0.2333 |
| 1.8436 | 5.0 | 535 | 2.0064 | 0.0727 | 0.1655 | 0.0484 | 0.0208 | 0.0538 | 0.0909 | 0.0845 | 0.1843 | 0.2026 | 0.0687 | 0.1459 | 0.2537 | 0.2407 | 0.5559 | 0.0107 | 0.0241 | 0.0208 | 0.1522 | 0.0 | 0.0 | 0.091 | 0.2809 |
| 1.7839 | 6.0 | 642 | 1.9382 | 0.095 | 0.2243 | 0.0766 | 0.0187 | 0.0753 | 0.1129 | 0.0997 | 0.2116 | 0.227 | 0.0801 | 0.177 | 0.2746 | 0.3235 | 0.5847 | 0.0243 | 0.1215 | 0.0387 | 0.1942 | 0.0 | 0.0 | 0.0881 | 0.2347 |
| 1.7793 | 7.0 | 749 | 2.0159 | 0.0993 | 0.2193 | 0.0844 | 0.0138 | 0.0822 | 0.1267 | 0.109 | 0.2014 | 0.2158 | 0.0485 | 0.1595 | 0.2898 | 0.3168 | 0.573 | 0.009 | 0.0709 | 0.0317 | 0.1598 | 0.002 | 0.0046 | 0.1368 | 0.2707 |
| 1.6682 | 8.0 | 856 | 1.8843 | 0.1193 | 0.251 | 0.1034 | 0.046 | 0.096 | 0.1632 | 0.1403 | 0.2527 | 0.2721 | 0.1071 | 0.2293 | 0.3346 | 0.3373 | 0.5793 | 0.0484 | 0.2443 | 0.0536 | 0.2156 | 0.0105 | 0.0431 | 0.1467 | 0.2782 |
| 1.5992 | 9.0 | 963 | 1.7163 | 0.13 | 0.2917 | 0.1109 | 0.0485 | 0.1064 | 0.1829 | 0.1504 | 0.2702 | 0.2897 | 0.1265 | 0.2203 | 0.4034 | 0.3907 | 0.605 | 0.0522 | 0.2608 | 0.0489 | 0.2339 | 0.0129 | 0.0723 | 0.1453 | 0.2764 |
| 1.5705 | 10.0 | 1070 | 1.8223 | 0.1188 | 0.2687 | 0.0982 | 0.0336 | 0.1011 | 0.1673 | 0.1506 | 0.2584 | 0.2765 | 0.1133 | 0.2172 | 0.3697 | 0.3468 | 0.5626 | 0.0509 | 0.1962 | 0.0432 | 0.2232 | 0.0178 | 0.1138 | 0.1354 | 0.2867 |
| 1.5646 | 11.0 | 1177 | 1.8070 | 0.1276 | 0.28 | 0.1026 | 0.0396 | 0.1042 | 0.1678 | 0.1568 | 0.2738 | 0.2874 | 0.0919 | 0.2256 | 0.3972 | 0.3954 | 0.6104 | 0.0503 | 0.219 | 0.0451 | 0.1902 | 0.0204 | 0.1569 | 0.1268 | 0.2604 |
| 1.5597 | 12.0 | 1284 | 1.7073 | 0.1384 | 0.3048 | 0.1109 | 0.0372 | 0.11 | 0.2093 | 0.1687 | 0.3119 | 0.326 | 0.0985 | 0.2638 | 0.4789 | 0.4113 | 0.6144 | 0.0611 | 0.2975 | 0.0593 | 0.2335 | 0.016 | 0.1938 | 0.1441 | 0.2907 |
| 1.5311 | 13.0 | 1391 | 1.6969 | 0.1418 | 0.3228 | 0.1037 | 0.041 | 0.1189 | 0.2127 | 0.1644 | 0.3219 | 0.3378 | 0.1096 | 0.2698 | 0.4917 | 0.3827 | 0.6149 | 0.0651 | 0.3329 | 0.0605 | 0.2496 | 0.0281 | 0.1662 | 0.1725 | 0.3253 |
| 1.4938 | 14.0 | 1498 | 1.6642 | 0.143 | 0.334 | 0.1047 | 0.0395 | 0.1192 | 0.2081 | 0.1726 | 0.3124 | 0.3267 | 0.1149 | 0.2483 | 0.4744 | 0.3883 | 0.6126 | 0.0734 | 0.3203 | 0.0609 | 0.2036 | 0.026 | 0.1862 | 0.1666 | 0.3107 |
| 1.4657 | 15.0 | 1605 | 1.6948 | 0.1364 | 0.3063 | 0.1131 | 0.0337 | 0.1013 | 0.2102 | 0.1555 | 0.3133 | 0.3364 | 0.1096 | 0.2581 | 0.4803 | 0.4141 | 0.6297 | 0.0425 | 0.3177 | 0.0666 | 0.2625 | 0.0186 | 0.1923 | 0.14 | 0.2796 |
| 1.4562 | 16.0 | 1712 | 1.6193 | 0.1418 | 0.3303 | 0.1095 | 0.0511 | 0.1269 | 0.2024 | 0.1864 | 0.3335 | 0.3475 | 0.1638 | 0.2885 | 0.4642 | 0.3925 | 0.586 | 0.0768 | 0.3595 | 0.0695 | 0.2629 | 0.0194 | 0.2231 | 0.1507 | 0.3058 |
| 1.43 | 17.0 | 1819 | 1.6391 | 0.145 | 0.3296 | 0.1157 | 0.0463 | 0.1137 | 0.2198 | 0.185 | 0.3437 | 0.365 | 0.1456 | 0.3134 | 0.5049 | 0.3985 | 0.6216 | 0.0628 | 0.3354 | 0.0813 | 0.3022 | 0.0263 | 0.2738 | 0.1561 | 0.292 |
| 1.4022 | 18.0 | 1926 | 1.6259 | 0.1433 | 0.3396 | 0.1087 | 0.0728 | 0.1105 | 0.2262 | 0.1864 | 0.3285 | 0.3485 | 0.1529 | 0.2787 | 0.4878 | 0.3654 | 0.6023 | 0.0708 | 0.3253 | 0.0843 | 0.2866 | 0.0187 | 0.2323 | 0.1772 | 0.296 |
| 1.355 | 19.0 | 2033 | 1.5473 | 0.1642 | 0.3599 | 0.135 | 0.0857 | 0.1245 | 0.2476 | 0.2 | 0.3577 | 0.3764 | 0.1384 | 0.3008 | 0.5502 | 0.4262 | 0.6356 | 0.059 | 0.3532 | 0.0858 | 0.3143 | 0.0465 | 0.2585 | 0.2036 | 0.3204 |
| 1.3404 | 20.0 | 2140 | 1.5296 | 0.1764 | 0.385 | 0.1342 | 0.0676 | 0.1438 | 0.2758 | 0.2176 | 0.3689 | 0.3839 | 0.1691 | 0.3191 | 0.5462 | 0.433 | 0.6302 | 0.1159 | 0.3709 | 0.0974 | 0.3071 | 0.0778 | 0.3185 | 0.1577 | 0.2929 |
| 1.3367 | 21.0 | 2247 | 1.5219 | 0.1862 | 0.387 | 0.1502 | 0.0444 | 0.1448 | 0.2963 | 0.2081 | 0.3752 | 0.3897 | 0.1477 | 0.3255 | 0.5503 | 0.449 | 0.6207 | 0.1136 | 0.3797 | 0.1141 | 0.3451 | 0.0434 | 0.2708 | 0.2107 | 0.332 |
| 1.2998 | 22.0 | 2354 | 1.4768 | 0.1853 | 0.393 | 0.1535 | 0.0445 | 0.148 | 0.2998 | 0.213 | 0.3762 | 0.3963 | 0.1822 | 0.3353 | 0.5332 | 0.4589 | 0.6207 | 0.1081 | 0.3873 | 0.1085 | 0.3562 | 0.0433 | 0.2862 | 0.2075 | 0.3311 |
| 1.2803 | 23.0 | 2461 | 1.4946 | 0.1907 | 0.4068 | 0.1517 | 0.0497 | 0.1561 | 0.2981 | 0.2056 | 0.3706 | 0.3887 | 0.1585 | 0.3412 | 0.5334 | 0.4496 | 0.6126 | 0.1129 | 0.3582 | 0.1335 | 0.35 | 0.0413 | 0.2862 | 0.2163 | 0.3364 |
| 1.2791 | 24.0 | 2568 | 1.4827 | 0.1897 | 0.3987 | 0.16 | 0.0537 | 0.1406 | 0.3015 | 0.2125 | 0.381 | 0.4019 | 0.1595 | 0.35 | 0.5525 | 0.4633 | 0.6342 | 0.0952 | 0.3987 | 0.1261 | 0.3643 | 0.0598 | 0.2892 | 0.2042 | 0.3231 |
| 1.2687 | 25.0 | 2675 | 1.4795 | 0.1916 | 0.4021 | 0.1626 | 0.0603 | 0.1453 | 0.3003 | 0.2281 | 0.3934 | 0.4079 | 0.1611 | 0.3539 | 0.572 | 0.4529 | 0.6356 | 0.0956 | 0.3797 | 0.1434 | 0.342 | 0.053 | 0.3569 | 0.2131 | 0.3253 |
| 1.229 | 26.0 | 2782 | 1.4817 | 0.1922 | 0.4226 | 0.153 | 0.0566 | 0.1579 | 0.3048 | 0.2213 | 0.3825 | 0.4028 | 0.1948 | 0.3408 | 0.551 | 0.4338 | 0.6324 | 0.1391 | 0.381 | 0.1195 | 0.3554 | 0.0495 | 0.3231 | 0.219 | 0.3222 |
| 1.2537 | 27.0 | 2889 | 1.5223 | 0.1891 | 0.4338 | 0.1469 | 0.0775 | 0.146 | 0.3004 | 0.2045 | 0.3696 | 0.3838 | 0.1806 | 0.3195 | 0.5276 | 0.4444 | 0.6279 | 0.1133 | 0.3418 | 0.1295 | 0.3246 | 0.0538 | 0.3108 | 0.2043 | 0.3142 |
| 1.2377 | 28.0 | 2996 | 1.4548 | 0.201 | 0.438 | 0.1538 | 0.0666 | 0.1556 | 0.3186 | 0.2286 | 0.3815 | 0.3944 | 0.1411 | 0.3428 | 0.5578 | 0.4559 | 0.6464 | 0.1395 | 0.3684 | 0.1193 | 0.3237 | 0.0437 | 0.2954 | 0.2466 | 0.3382 |
| 1.217 | 29.0 | 3103 | 1.4579 | 0.1994 | 0.4129 | 0.176 | 0.0595 | 0.169 | 0.2965 | 0.2188 | 0.3871 | 0.4006 | 0.1797 | 0.3454 | 0.5306 | 0.4727 | 0.6586 | 0.1088 | 0.3747 | 0.1282 | 0.35 | 0.075 | 0.2846 | 0.2123 | 0.3351 |
| 1.2252 | 30.0 | 3210 | 1.4552 | 0.2073 | 0.4341 | 0.1633 | 0.0631 | 0.1543 | 0.3287 | 0.2294 | 0.3874 | 0.4038 | 0.1423 | 0.3425 | 0.5571 | 0.4684 | 0.6405 | 0.1528 | 0.4051 | 0.1395 | 0.3496 | 0.0438 | 0.2831 | 0.2319 | 0.3409 |
| 1.1804 | 31.0 | 3317 | 1.4339 | 0.2028 | 0.4352 | 0.16 | 0.0653 | 0.1578 | 0.3171 | 0.2269 | 0.3964 | 0.4141 | 0.152 | 0.3696 | 0.5676 | 0.4541 | 0.6419 | 0.1316 | 0.4139 | 0.1457 | 0.358 | 0.0667 | 0.3292 | 0.2159 | 0.3276 |
| 1.196 | 32.0 | 3424 | 1.4619 | 0.2181 | 0.4529 | 0.1874 | 0.0569 | 0.1666 | 0.346 | 0.2385 | 0.402 | 0.42 | 0.174 | 0.355 | 0.5965 | 0.4675 | 0.6144 | 0.1746 | 0.4 | 0.1536 | 0.3638 | 0.0662 | 0.3785 | 0.2285 | 0.3431 |
| 1.1698 | 33.0 | 3531 | 1.4126 | 0.2124 | 0.4458 | 0.1643 | 0.0633 | 0.164 | 0.3296 | 0.2287 | 0.3946 | 0.411 | 0.1707 | 0.3507 | 0.5705 | 0.4923 | 0.6613 | 0.1324 | 0.3848 | 0.1536 | 0.3656 | 0.0601 | 0.2969 | 0.2237 | 0.3462 |
| 1.143 | 34.0 | 3638 | 1.4011 | 0.2225 | 0.4598 | 0.1867 | 0.0671 | 0.175 | 0.3485 | 0.239 | 0.4124 | 0.4257 | 0.1549 | 0.3674 | 0.6062 | 0.4852 | 0.6477 | 0.1527 | 0.4177 | 0.1693 | 0.354 | 0.0755 | 0.3769 | 0.2296 | 0.332 |
| 1.1527 | 35.0 | 3745 | 1.4047 | 0.2309 | 0.4622 | 0.1979 | 0.0689 | 0.168 | 0.3785 | 0.2431 | 0.415 | 0.4277 | 0.1665 | 0.3677 | 0.5928 | 0.5132 | 0.6559 | 0.1427 | 0.3924 | 0.1703 | 0.3808 | 0.0946 | 0.3662 | 0.2337 | 0.3431 |
| 1.1219 | 36.0 | 3852 | 1.4185 | 0.2224 | 0.4747 | 0.1906 | 0.0727 | 0.1709 | 0.3493 | 0.2326 | 0.3971 | 0.4124 | 0.1584 | 0.355 | 0.5743 | 0.4772 | 0.6423 | 0.167 | 0.3899 | 0.1535 | 0.3219 | 0.0574 | 0.34 | 0.2569 | 0.368 |
| 1.1115 | 37.0 | 3959 | 1.3970 | 0.2271 | 0.4682 | 0.1883 | 0.071 | 0.1725 | 0.3602 | 0.2514 | 0.4163 | 0.4357 | 0.1589 | 0.3851 | 0.5976 | 0.4954 | 0.6577 | 0.1483 | 0.4013 | 0.1626 | 0.3754 | 0.0907 | 0.3969 | 0.2388 | 0.3471 |
| 1.0974 | 38.0 | 4066 | 1.4054 | 0.231 | 0.4814 | 0.1923 | 0.0625 | 0.1778 | 0.378 | 0.2464 | 0.4218 | 0.4397 | 0.1703 | 0.3886 | 0.6013 | 0.5061 | 0.6532 | 0.1707 | 0.4367 | 0.1685 | 0.3879 | 0.087 | 0.38 | 0.2229 | 0.3404 |
| 1.0815 | 39.0 | 4173 | 1.4458 | 0.2318 | 0.4829 | 0.1897 | 0.0721 | 0.1782 | 0.384 | 0.2433 | 0.4168 | 0.4381 | 0.1661 | 0.3886 | 0.6148 | 0.4742 | 0.655 | 0.1857 | 0.4127 | 0.174 | 0.3732 | 0.0922 | 0.3969 | 0.2328 | 0.3529 |
| 1.0897 | 40.0 | 4280 | 1.3788 | 0.2299 | 0.4735 | 0.1929 | 0.0679 | 0.1631 | 0.3756 | 0.2416 | 0.4173 | 0.4351 | 0.1662 | 0.3589 | 0.6283 | 0.5099 | 0.6712 | 0.1595 | 0.4203 | 0.1617 | 0.3723 | 0.0732 | 0.3431 | 0.2452 | 0.3689 |
| 1.0615 | 41.0 | 4387 | 1.3891 | 0.2411 | 0.5032 | 0.2139 | 0.0751 | 0.1771 | 0.3803 | 0.2494 | 0.4131 | 0.4292 | 0.187 | 0.3604 | 0.6034 | 0.519 | 0.664 | 0.1938 | 0.4354 | 0.1612 | 0.3504 | 0.0892 | 0.36 | 0.2421 | 0.336 |
| 1.0573 | 42.0 | 4494 | 1.3824 | 0.2419 | 0.4938 | 0.2121 | 0.068 | 0.1744 | 0.3942 | 0.2634 | 0.4166 | 0.4287 | 0.1677 | 0.3598 | 0.611 | 0.509 | 0.6667 | 0.1917 | 0.4316 | 0.1661 | 0.3607 | 0.1 | 0.3385 | 0.2427 | 0.3458 |
| 1.0504 | 43.0 | 4601 | 1.3565 | 0.2497 | 0.5184 | 0.2224 | 0.0703 | 0.1896 | 0.3926 | 0.2513 | 0.4333 | 0.4496 | 0.2086 | 0.3955 | 0.6028 | 0.5132 | 0.6662 | 0.2108 | 0.4418 | 0.1847 | 0.3951 | 0.0962 | 0.3862 | 0.2435 | 0.3587 |
| 1.0575 | 44.0 | 4708 | 1.3194 | 0.2326 | 0.4773 | 0.201 | 0.062 | 0.18 | 0.384 | 0.2408 | 0.4312 | 0.4467 | 0.2068 | 0.3814 | 0.6097 | 0.5039 | 0.6725 | 0.1953 | 0.462 | 0.1625 | 0.367 | 0.0723 | 0.3785 | 0.229 | 0.3533 |
| 1.0356 | 45.0 | 4815 | 1.3503 | 0.2355 | 0.493 | 0.2068 | 0.0704 | 0.1795 | 0.3794 | 0.2598 | 0.4328 | 0.4489 | 0.1803 | 0.3783 | 0.6254 | 0.5124 | 0.6752 | 0.1886 | 0.4658 | 0.1516 | 0.3518 | 0.0917 | 0.3954 | 0.2331 | 0.3564 |
| 1.0766 | 46.0 | 4922 | 1.3880 | 0.2407 | 0.5086 | 0.205 | 0.0848 | 0.1864 | 0.3725 | 0.2517 | 0.4316 | 0.4475 | 0.1847 | 0.3949 | 0.6098 | 0.5322 | 0.6734 | 0.172 | 0.4709 | 0.1544 | 0.3313 | 0.0981 | 0.4123 | 0.2467 | 0.3498 |
| 1.0632 | 47.0 | 5029 | 1.3330 | 0.2473 | 0.5065 | 0.2145 | 0.0583 | 0.1901 | 0.3987 | 0.2548 | 0.4249 | 0.4443 | 0.172 | 0.3909 | 0.6116 | 0.5287 | 0.6626 | 0.2018 | 0.4544 | 0.1714 | 0.3795 | 0.0818 | 0.3677 | 0.2531 | 0.3573 |
| 1.0451 | 48.0 | 5136 | 1.3742 | 0.2405 | 0.4981 | 0.2093 | 0.0741 | 0.1883 | 0.3839 | 0.2573 | 0.4241 | 0.4352 | 0.1595 | 0.3878 | 0.6145 | 0.5253 | 0.6815 | 0.1927 | 0.4342 | 0.1545 | 0.3388 | 0.0889 | 0.3708 | 0.2412 | 0.3507 |
| 1.0421 | 49.0 | 5243 | 1.3462 | 0.254 | 0.5327 | 0.2251 | 0.0803 | 0.2014 | 0.4042 | 0.2603 | 0.4233 | 0.4433 | 0.1951 | 0.388 | 0.6098 | 0.5287 | 0.673 | 0.2031 | 0.4291 | 0.1752 | 0.3647 | 0.0941 | 0.3723 | 0.2687 | 0.3773 |
| 1.0075 | 50.0 | 5350 | 1.3627 | 0.2554 | 0.5047 | 0.2309 | 0.0597 | 0.1887 | 0.4272 | 0.2636 | 0.4368 | 0.4541 | 0.17 | 0.3863 | 0.6523 | 0.5321 | 0.6703 | 0.2103 | 0.4772 | 0.182 | 0.3728 | 0.0993 | 0.3831 | 0.2534 | 0.3671 |
| 1.0206 | 51.0 | 5457 | 1.3867 | 0.2514 | 0.512 | 0.214 | 0.0628 | 0.1821 | 0.4166 | 0.2599 | 0.4278 | 0.4428 | 0.1467 | 0.3731 | 0.6462 | 0.5356 | 0.6788 | 0.1927 | 0.4468 | 0.1813 | 0.3558 | 0.0991 | 0.3723 | 0.2482 | 0.36 |
| 1.0196 | 52.0 | 5564 | 1.3444 | 0.2562 | 0.5201 | 0.2122 | 0.0562 | 0.1917 | 0.4182 | 0.2598 | 0.4333 | 0.4469 | 0.1661 | 0.3853 | 0.6292 | 0.5361 | 0.673 | 0.1917 | 0.4228 | 0.1788 | 0.3723 | 0.116 | 0.4123 | 0.2585 | 0.3542 |
| 0.9788 | 53.0 | 5671 | 1.3625 | 0.2484 | 0.5059 | 0.2031 | 0.063 | 0.1887 | 0.4126 | 0.2663 | 0.4392 | 0.4544 | 0.1656 | 0.3975 | 0.6338 | 0.5098 | 0.6734 | 0.1791 | 0.4468 | 0.1718 | 0.3612 | 0.1273 | 0.4108 | 0.2541 | 0.38 |
| 1.0195 | 54.0 | 5778 | 1.3207 | 0.2604 | 0.5269 | 0.2224 | 0.069 | 0.2027 | 0.4196 | 0.2626 | 0.4382 | 0.4527 | 0.1912 | 0.3909 | 0.6223 | 0.5341 | 0.6892 | 0.1927 | 0.457 | 0.1783 | 0.3696 | 0.1288 | 0.3785 | 0.2683 | 0.3693 |
| 0.9709 | 55.0 | 5885 | 1.3276 | 0.2648 | 0.5331 | 0.2205 | 0.0629 | 0.2026 | 0.443 | 0.2763 | 0.4414 | 0.4555 | 0.1709 | 0.4012 | 0.6281 | 0.5389 | 0.6923 | 0.1999 | 0.4443 | 0.1873 | 0.3759 | 0.1313 | 0.3938 | 0.2664 | 0.3711 |
| 0.9539 | 56.0 | 5992 | 1.3213 | 0.2621 | 0.5399 | 0.2236 | 0.0608 | 0.2069 | 0.4189 | 0.2664 | 0.4313 | 0.4497 | 0.2057 | 0.3859 | 0.6112 | 0.5355 | 0.6788 | 0.182 | 0.4304 | 0.1968 | 0.3982 | 0.1361 | 0.3815 | 0.2599 | 0.3596 |
| 0.9704 | 57.0 | 6099 | 1.3051 | 0.2687 | 0.5342 | 0.2298 | 0.0807 | 0.2104 | 0.4223 | 0.2824 | 0.4485 | 0.4641 | 0.1862 | 0.4063 | 0.6406 | 0.5348 | 0.6919 | 0.2088 | 0.4722 | 0.1978 | 0.3888 | 0.121 | 0.3938 | 0.2812 | 0.3738 |
| 0.9689 | 58.0 | 6206 | 1.3027 | 0.2675 | 0.5398 | 0.2294 | 0.0731 | 0.2088 | 0.4298 | 0.2793 | 0.4454 | 0.459 | 0.1659 | 0.4005 | 0.6364 | 0.5396 | 0.6874 | 0.1856 | 0.4595 | 0.189 | 0.3795 | 0.139 | 0.3892 | 0.2842 | 0.3796 |
| 0.9491 | 59.0 | 6313 | 1.3377 | 0.2575 | 0.5237 | 0.2173 | 0.0655 | 0.1992 | 0.412 | 0.265 | 0.4424 | 0.4569 | 0.2028 | 0.3954 | 0.6316 | 0.5307 | 0.668 | 0.1743 | 0.4532 | 0.195 | 0.3835 | 0.1042 | 0.4 | 0.2835 | 0.38 |
| 0.9635 | 60.0 | 6420 | 1.3185 | 0.265 | 0.5431 | 0.2265 | 0.0715 | 0.2135 | 0.4079 | 0.2812 | 0.4446 | 0.4581 | 0.1858 | 0.3986 | 0.6338 | 0.5458 | 0.6833 | 0.1812 | 0.4494 | 0.1877 | 0.3701 | 0.1196 | 0.3862 | 0.2909 | 0.4013 |
| 0.9593 | 61.0 | 6527 | 1.3583 | 0.2649 | 0.5335 | 0.2213 | 0.07 | 0.217 | 0.4138 | 0.2731 | 0.4422 | 0.4544 | 0.1639 | 0.3965 | 0.6381 | 0.539 | 0.677 | 0.195 | 0.4557 | 0.1766 | 0.3562 | 0.1344 | 0.4092 | 0.2795 | 0.3738 |
| 0.933 | 62.0 | 6634 | 1.3281 | 0.2729 | 0.5496 | 0.2352 | 0.0762 | 0.2242 | 0.4251 | 0.2746 | 0.4517 | 0.463 | 0.1973 | 0.4129 | 0.6345 | 0.5414 | 0.6874 | 0.2034 | 0.457 | 0.1926 | 0.371 | 0.1363 | 0.4108 | 0.2909 | 0.3889 |
| 0.9589 | 63.0 | 6741 | 1.3673 | 0.2617 | 0.5234 | 0.2331 | 0.0794 | 0.2033 | 0.4155 | 0.2597 | 0.4321 | 0.4496 | 0.1788 | 0.3914 | 0.6124 | 0.5325 | 0.6676 | 0.186 | 0.4772 | 0.1923 | 0.3504 | 0.1145 | 0.3815 | 0.2833 | 0.3711 |
| 0.9557 | 64.0 | 6848 | 1.2880 | 0.2704 | 0.5518 | 0.2401 | 0.0795 | 0.2233 | 0.4197 | 0.2705 | 0.4506 | 0.4692 | 0.1936 | 0.4216 | 0.6227 | 0.5492 | 0.6842 | 0.2033 | 0.4671 | 0.1963 | 0.3879 | 0.1148 | 0.4185 | 0.2887 | 0.3884 |
| 0.9207 | 65.0 | 6955 | 1.3327 | 0.2744 | 0.5535 | 0.2341 | 0.0692 | 0.2246 | 0.4331 | 0.2826 | 0.4535 | 0.4698 | 0.1961 | 0.4125 | 0.6362 | 0.5375 | 0.6811 | 0.1987 | 0.4684 | 0.2095 | 0.3978 | 0.1394 | 0.4154 | 0.2868 | 0.3862 |
| 0.9078 | 66.0 | 7062 | 1.3275 | 0.2615 | 0.5261 | 0.2218 | 0.0622 | 0.1935 | 0.4505 | 0.2698 | 0.4451 | 0.462 | 0.1656 | 0.4076 | 0.6531 | 0.5365 | 0.6752 | 0.1989 | 0.4785 | 0.1834 | 0.3929 | 0.1158 | 0.3877 | 0.2727 | 0.3756 |
| 0.9286 | 67.0 | 7169 | 1.3468 | 0.2635 | 0.5273 | 0.2271 | 0.0778 | 0.2009 | 0.434 | 0.2806 | 0.4361 | 0.4506 | 0.171 | 0.3927 | 0.6282 | 0.5425 | 0.6928 | 0.2065 | 0.4519 | 0.1856 | 0.3795 | 0.1034 | 0.3446 | 0.2795 | 0.384 |
| 0.918 | 68.0 | 7276 | 1.3399 | 0.2619 | 0.5326 | 0.2171 | 0.0731 | 0.1994 | 0.4347 | 0.2872 | 0.4402 | 0.4614 | 0.1772 | 0.4053 | 0.6393 | 0.5374 | 0.6883 | 0.2019 | 0.4582 | 0.1865 | 0.383 | 0.1157 | 0.3923 | 0.2681 | 0.3853 |
| 0.9117 | 69.0 | 7383 | 1.3267 | 0.2575 | 0.5197 | 0.2169 | 0.0737 | 0.2062 | 0.4202 | 0.2769 | 0.4475 | 0.4665 | 0.1975 | 0.4126 | 0.6317 | 0.5341 | 0.6833 | 0.2002 | 0.4684 | 0.1777 | 0.3924 | 0.1094 | 0.4046 | 0.2658 | 0.3836 |
| 0.8936 | 70.0 | 7490 | 1.3458 | 0.2572 | 0.525 | 0.2233 | 0.0594 | 0.1985 | 0.4259 | 0.282 | 0.4446 | 0.4629 | 0.1609 | 0.4085 | 0.6491 | 0.5157 | 0.6743 | 0.1914 | 0.4747 | 0.1781 | 0.383 | 0.1315 | 0.3954 | 0.2692 | 0.3871 |
| 0.896 | 71.0 | 7597 | 1.3293 | 0.2648 | 0.5316 | 0.2153 | 0.0647 | 0.2137 | 0.4176 | 0.2743 | 0.449 | 0.4654 | 0.1767 | 0.4172 | 0.6278 | 0.5403 | 0.6874 | 0.2002 | 0.4835 | 0.1774 | 0.3768 | 0.125 | 0.3846 | 0.2812 | 0.3947 |
| 0.8923 | 72.0 | 7704 | 1.3015 | 0.2709 | 0.5507 | 0.2271 | 0.083 | 0.2053 | 0.4296 | 0.2824 | 0.4503 | 0.4652 | 0.1908 | 0.4006 | 0.6412 | 0.5475 | 0.6901 | 0.2006 | 0.4443 | 0.1862 | 0.4013 | 0.1426 | 0.3985 | 0.2775 | 0.392 |
| 0.8798 | 73.0 | 7811 | 1.3031 | 0.2762 | 0.5469 | 0.2388 | 0.0779 | 0.2202 | 0.436 | 0.2835 | 0.4514 | 0.4681 | 0.1769 | 0.41 | 0.6419 | 0.5424 | 0.6829 | 0.2074 | 0.4582 | 0.2024 | 0.4062 | 0.1443 | 0.4 | 0.2844 | 0.3933 |
| 0.8847 | 74.0 | 7918 | 1.3144 | 0.268 | 0.5423 | 0.2231 | 0.0607 | 0.2132 | 0.4356 | 0.2825 | 0.4432 | 0.4594 | 0.1679 | 0.402 | 0.6463 | 0.5228 | 0.6626 | 0.2193 | 0.4684 | 0.1887 | 0.3826 | 0.1295 | 0.3985 | 0.2799 | 0.3849 |
| 0.8807 | 75.0 | 8025 | 1.3156 | 0.2786 | 0.5623 | 0.223 | 0.0799 | 0.2261 | 0.4339 | 0.28 | 0.4606 | 0.4783 | 0.1901 | 0.4283 | 0.6482 | 0.5193 | 0.6739 | 0.2351 | 0.4975 | 0.2034 | 0.408 | 0.1433 | 0.4185 | 0.2917 | 0.3938 |
| 0.8688 | 76.0 | 8132 | 1.2824 | 0.2785 | 0.5646 | 0.2328 | 0.0845 | 0.2194 | 0.4509 | 0.2801 | 0.4503 | 0.4689 | 0.1796 | 0.4177 | 0.6467 | 0.5337 | 0.6761 | 0.2323 | 0.4835 | 0.1959 | 0.404 | 0.1395 | 0.3846 | 0.291 | 0.3964 |
| 0.8766 | 77.0 | 8239 | 1.2948 | 0.279 | 0.5517 | 0.2413 | 0.0735 | 0.2307 | 0.4358 | 0.2809 | 0.4505 | 0.4694 | 0.1925 | 0.4164 | 0.6332 | 0.5427 | 0.682 | 0.2324 | 0.4684 | 0.1924 | 0.3964 | 0.1428 | 0.4 | 0.2849 | 0.4 |
| 0.8724 | 78.0 | 8346 | 1.3041 | 0.2797 | 0.5574 | 0.25 | 0.0824 | 0.226 | 0.4462 | 0.2828 | 0.4567 | 0.4742 | 0.2142 | 0.4164 | 0.6516 | 0.5322 | 0.677 | 0.2371 | 0.4785 | 0.1844 | 0.4098 | 0.1493 | 0.4031 | 0.2956 | 0.4027 |
| 0.859 | 79.0 | 8453 | 1.2883 | 0.2823 | 0.558 | 0.2424 | 0.0663 | 0.2175 | 0.455 | 0.289 | 0.4525 | 0.4694 | 0.199 | 0.4096 | 0.6468 | 0.553 | 0.6865 | 0.2147 | 0.4557 | 0.1929 | 0.404 | 0.1615 | 0.4062 | 0.2893 | 0.3947 |
| 0.8585 | 80.0 | 8560 | 1.2863 | 0.2819 | 0.56 | 0.2468 | 0.0881 | 0.226 | 0.4642 | 0.2869 | 0.4554 | 0.4732 | 0.2034 | 0.4168 | 0.6486 | 0.5333 | 0.6838 | 0.2378 | 0.4671 | 0.1948 | 0.4085 | 0.1424 | 0.4 | 0.3012 | 0.4067 |
| 0.8454 | 81.0 | 8667 | 1.2876 | 0.284 | 0.5586 | 0.2495 | 0.0808 | 0.2252 | 0.4634 | 0.2885 | 0.4597 | 0.4767 | 0.1803 | 0.425 | 0.664 | 0.5307 | 0.6838 | 0.2354 | 0.4709 | 0.2103 | 0.4098 | 0.1428 | 0.4077 | 0.3007 | 0.4116 |
| 0.8513 | 82.0 | 8774 | 1.2763 | 0.2848 | 0.5614 | 0.2489 | 0.0834 | 0.2375 | 0.4469 | 0.2822 | 0.4581 | 0.473 | 0.2089 | 0.4262 | 0.6339 | 0.5428 | 0.6788 | 0.2372 | 0.4582 | 0.2026 | 0.4103 | 0.1401 | 0.4 | 0.3013 | 0.4178 |
| 0.8371 | 83.0 | 8881 | 1.2659 | 0.2884 | 0.5674 | 0.252 | 0.089 | 0.2261 | 0.457 | 0.2812 | 0.4588 | 0.4706 | 0.1991 | 0.4131 | 0.6465 | 0.5492 | 0.6896 | 0.2394 | 0.4405 | 0.203 | 0.4062 | 0.1429 | 0.4046 | 0.3075 | 0.412 |
| 0.8459 | 84.0 | 8988 | 1.2862 | 0.2877 | 0.5667 | 0.2514 | 0.0876 | 0.2176 | 0.4602 | 0.2839 | 0.4587 | 0.4707 | 0.1898 | 0.4192 | 0.6436 | 0.5562 | 0.6959 | 0.2376 | 0.4519 | 0.2045 | 0.3879 | 0.1435 | 0.4062 | 0.2969 | 0.4116 |
| 0.8232 | 85.0 | 9095 | 1.2927 | 0.2878 | 0.5693 | 0.251 | 0.0894 | 0.2314 | 0.4523 | 0.2877 | 0.4589 | 0.4759 | 0.2037 | 0.4273 | 0.6478 | 0.5332 | 0.677 | 0.2346 | 0.4582 | 0.2112 | 0.404 | 0.1518 | 0.4215 | 0.3081 | 0.4187 |
| 0.8476 | 86.0 | 9202 | 1.2649 | 0.288 | 0.5683 | 0.2496 | 0.0723 | 0.2332 | 0.4597 | 0.2896 | 0.4624 | 0.4774 | 0.1947 | 0.4314 | 0.6485 | 0.5407 | 0.6838 | 0.2411 | 0.4759 | 0.206 | 0.4049 | 0.1508 | 0.4092 | 0.3013 | 0.4133 |
| 0.8191 | 87.0 | 9309 | 1.2794 | 0.2913 | 0.5706 | 0.2503 | 0.0819 | 0.2303 | 0.4605 | 0.2871 | 0.4619 | 0.4766 | 0.1945 | 0.4228 | 0.6558 | 0.5484 | 0.6869 | 0.2381 | 0.4658 | 0.2186 | 0.4071 | 0.1435 | 0.4138 | 0.3082 | 0.4093 |
| 0.8345 | 88.0 | 9416 | 1.2816 | 0.2887 | 0.568 | 0.2535 | 0.083 | 0.2213 | 0.4599 | 0.2912 | 0.4631 | 0.4765 | 0.1943 | 0.4239 | 0.647 | 0.5451 | 0.6847 | 0.2384 | 0.4671 | 0.2093 | 0.4071 | 0.1427 | 0.4092 | 0.3079 | 0.4142 |
| 0.8313 | 89.0 | 9523 | 1.2714 | 0.2885 | 0.5718 | 0.2531 | 0.087 | 0.2287 | 0.451 | 0.2879 | 0.4624 | 0.475 | 0.2005 | 0.4227 | 0.6405 | 0.5375 | 0.691 | 0.2392 | 0.457 | 0.2122 | 0.4031 | 0.1485 | 0.4185 | 0.3052 | 0.4053 |
| 0.8305 | 90.0 | 9630 | 1.2669 | 0.2939 | 0.5665 | 0.2578 | 0.0852 | 0.2304 | 0.4619 | 0.2927 | 0.4614 | 0.4737 | 0.1981 | 0.4197 | 0.6446 | 0.5448 | 0.6901 | 0.2471 | 0.4722 | 0.2069 | 0.3978 | 0.1628 | 0.4031 | 0.3077 | 0.4053 |
| 0.8059 | 91.0 | 9737 | 1.2680 | 0.2961 | 0.5782 | 0.2599 | 0.0836 | 0.2329 | 0.4598 | 0.29 | 0.4648 | 0.4782 | 0.1917 | 0.4262 | 0.6443 | 0.5487 | 0.686 | 0.2416 | 0.4785 | 0.2124 | 0.3969 | 0.1682 | 0.4154 | 0.3093 | 0.4142 |
| 0.8096 | 92.0 | 9844 | 1.2710 | 0.2943 | 0.5708 | 0.2545 | 0.087 | 0.2293 | 0.4586 | 0.2935 | 0.4668 | 0.4794 | 0.1969 | 0.4281 | 0.6435 | 0.5454 | 0.6851 | 0.2481 | 0.481 | 0.2074 | 0.4022 | 0.163 | 0.42 | 0.3076 | 0.4084 |
| 0.8043 | 93.0 | 9951 | 1.2747 | 0.2884 | 0.5648 | 0.2437 | 0.0865 | 0.2269 | 0.4489 | 0.2894 | 0.4615 | 0.4745 | 0.1989 | 0.4222 | 0.6391 | 0.5403 | 0.6784 | 0.2408 | 0.4722 | 0.204 | 0.3973 | 0.1516 | 0.4231 | 0.3054 | 0.4013 |
| 0.7964 | 94.0 | 10058 | 1.2638 | 0.2906 | 0.5734 | 0.2484 | 0.0881 | 0.2312 | 0.4542 | 0.29 | 0.4613 | 0.4738 | 0.1999 | 0.417 | 0.6446 | 0.5392 | 0.6775 | 0.2467 | 0.4785 | 0.2084 | 0.404 | 0.1538 | 0.4062 | 0.3048 | 0.4031 |
| 0.8133 | 95.0 | 10165 | 1.2622 | 0.3009 | 0.5852 | 0.2613 | 0.0871 | 0.2313 | 0.4755 | 0.2928 | 0.4669 | 0.4796 | 0.2031 | 0.4208 | 0.6534 | 0.5452 | 0.6829 | 0.2581 | 0.4848 | 0.2118 | 0.4058 | 0.1772 | 0.4092 | 0.312 | 0.4151 |
| 0.8176 | 96.0 | 10272 | 1.2640 | 0.2956 | 0.5816 | 0.2523 | 0.0897 | 0.2321 | 0.4621 | 0.2904 | 0.4618 | 0.4741 | 0.2036 | 0.4181 | 0.6464 | 0.5422 | 0.6784 | 0.256 | 0.4646 | 0.2087 | 0.4049 | 0.1638 | 0.4138 | 0.307 | 0.4089 |
| 0.7903 | 97.0 | 10379 | 1.2567 | 0.3006 | 0.5885 | 0.2594 | 0.0918 | 0.2321 | 0.4755 | 0.294 | 0.4705 | 0.4846 | 0.2013 | 0.4258 | 0.6651 | 0.5444 | 0.6883 | 0.2582 | 0.481 | 0.2132 | 0.4116 | 0.177 | 0.4277 | 0.3104 | 0.4142 |
| 0.8068 | 98.0 | 10486 | 1.2697 | 0.296 | 0.585 | 0.2573 | 0.0895 | 0.2316 | 0.464 | 0.2909 | 0.4663 | 0.4802 | 0.2035 | 0.4213 | 0.6567 | 0.5387 | 0.6851 | 0.2574 | 0.4772 | 0.2116 | 0.4058 | 0.1638 | 0.4215 | 0.3085 | 0.4111 |
| 0.7942 | 99.0 | 10593 | 1.2727 | 0.2972 | 0.5896 | 0.2589 | 0.0846 | 0.2341 | 0.4657 | 0.2927 | 0.4649 | 0.479 | 0.1962 | 0.422 | 0.657 | 0.5424 | 0.6851 | 0.2527 | 0.4696 | 0.2101 | 0.4049 | 0.1715 | 0.4215 | 0.3096 | 0.4138 |
| 0.8099 | 100.0 | 10700 | 1.2733 | 0.2965 | 0.5888 | 0.2549 | 0.085 | 0.2348 | 0.4635 | 0.2926 | 0.4628 | 0.4771 | 0.1972 | 0.4214 | 0.6518 | 0.5413 | 0.6838 | 0.2526 | 0.4696 | 0.2117 | 0.4036 | 0.1686 | 0.4169 | 0.3083 | 0.4116 |
### Framework versions
- Transformers 4.52.0.dev0
- Pytorch 2.6.0+cu124
- Datasets 2.21.0
- Tokenizers 0.21.1
|