Hugging Face's logo

OpenGVLab
/
InternVL2_5-Pretrain-Models

Image-Text-to-Text
Transformers
Safetensors
multilingual
internvl
vision
ocr
multi-image
video
custom_code
Model card Files Community
InternVL2_5-Pretrain-Models / InternVL2_5-2B-Pretrain /eval_llm_benchmark.log
czczup's picture
czczup
Release InternVL 2.5 pretrained models
3d12ff9 verified
raw
history blame contribute delete
30.8 kB
/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl_eval/lib/python3.10/site-packages/bitsandbytes/cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl_eval/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cpu.so: undefined symbol: cadam32bit_grad_fp32
model path is /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/work_dirs/internvl_chat_v2_5/internvl_chat_v2_5_internlm2_1_8b_dynamic_res_pretrain/checkpoint-33200
09/21 19:46:27 - OpenCompass - WARNING - No previous results to reuse!
09/21 19:46:27 - OpenCompass - INFO - Reusing experiements from 20240921_194627
09/21 19:46:27 - OpenCompass - INFO - Current exp folder: /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/work_dirs/internvl_chat_v2_5/internvl_chat_v2_5_internlm2_1_8b_dynamic_res_pretrain/checkpoint-33200/20240921_194627
09/21 19:46:31 - OpenCompass - INFO - Partitioned into 32 tasks.
[ ] 0/32, elapsed: 0s, ETA: [ ] 1/32, 0.0 task/s, elapsed: 3708s, ETA: 114952s [> ] 2/32, 0.0 task/s, elapsed: 3718s, ETA: 55774s [>> ] 3/32, 0.0 task/s, elapsed: 3753s, ETA: 36282s [>>> ] 4/32, 0.0 task/s, elapsed: 3843s, ETA: 26902s [>>>> ] 5/32, 0.0 task/s, elapsed: 3883s, ETA: 20970s [>>>>> ] 6/32, 0.0 task/s, elapsed: 3899s, ETA: 16894s [>>>>>> ] 7/32, 0.0 task/s, elapsed: 4079s, ETA: 14569s [>>>>>>> ] 8/32, 0.0 task/s, elapsed: 4134s, ETA: 12403s [>>>>>>>> ] 9/32, 0.0 task/s, elapsed: 4205s, ETA: 10745s [>>>>>>>>> ] 10/32, 0.0 task/s, elapsed: 4224s, ETA: 9294s [>>>>>>>>>> ] 11/32, 0.0 task/s, elapsed: 4230s, ETA: 8075s [>>>>>>>>>>> ] 12/32, 0.0 task/s, elapsed: 4244s, ETA: 7073s [>>>>>>>>>>>> ] 13/32, 0.0 task/s, elapsed: 4250s, ETA: 6211s [>>>>>>>>>>>>> ] 14/32, 0.0 task/s, elapsed: 4270s, ETA: 5490s [>>>>>>>>>>>>>> ] 15/32, 0.0 task/s, elapsed: 4294s, ETA: 4867s [>>>>>>>>>>>>>>> ] 16/32, 0.0 task/s, elapsed: 4405s, ETA: 4405s [>>>>>>>>>>>>>>> ] 17/32, 0.0 task/s, elapsed: 4429s, ETA: 3908s [>>>>>>>>>>>>>>>> ] 18/32, 0.0 task/s, elapsed: 4445s, ETA: 3457s [>>>>>>>>>>>>>>>>> ] 19/32, 0.0 task/s, elapsed: 4514s, ETA: 3089s [>>>>>>>>>>>>>>>>>> ] 20/32, 0.0 task/s, elapsed: 4599s, ETA: 2759s [>>>>>>>>>>>>>>>>>>> ] 21/32, 0.0 task/s, elapsed: 4608s, ETA: 2414s [>>>>>>>>>>>>>>>>>>>> ] 22/32, 0.0 task/s, elapsed: 4665s, ETA: 2120s [>>>>>>>>>>>>>>>>>>>>> ] 23/32, 0.0 task/s, elapsed: 4668s, ETA: 1827s [>>>>>>>>>>>>>>>>>>>>>> ] 24/32, 0.0 task/s, elapsed: 4679s, ETA: 1560s [>>>>>>>>>>>>>>>>>>>>>>> ] 25/32, 0.0 task/s, elapsed: 4745s, ETA: 1329s [>>>>>>>>>>>>>>>>>>>>>>>> ] 26/32, 0.0 task/s, elapsed: 4909s, ETA: 1133s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 27/32, 0.0 task/s, elapsed: 4924s, ETA: 912s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 28/32, 0.0 task/s, elapsed: 4949s, ETA: 707s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 29/32, 0.0 task/s, elapsed: 4959s, ETA: 513s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 30/32, 0.0 task/s, elapsed: 4971s, ETA: 331s [>>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 31/32, 0.0 task/s, elapsed: 4999s, ETA: 161s [>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 32/32, 0.0 task/s, elapsed: 5216s, ETA: 0s
09/21 21:13:28 - OpenCompass - INFO - Partitioned into 287 tasks.
[ ] 0/287, elapsed: 0s, ETA: [ ] 1/287, 0.0 task/s, elapsed: 67s, ETA: 19142s [ ] 2/287, 0.0 task/s, elapsed: 67s, ETA: 9552s [ ] 3/287, 0.0 task/s, elapsed: 67s, ETA: 6351s [ ] 4/287, 0.1 task/s, elapsed: 67s, ETA: 4751s [ ] 5/287, 0.1 task/s, elapsed: 67s, ETA: 3787s [ ] 6/287, 0.1 task/s, elapsed: 67s, ETA: 3147s [ ] 7/287, 0.1 task/s, elapsed: 67s, ETA: 2688s [ ] 8/287, 0.1 task/s, elapsed: 67s, ETA: 2344s [> ] 9/287, 0.1 task/s, elapsed: 67s, ETA: 2078s [> ] 10/287, 0.1 task/s, elapsed: 67s, ETA: 1864s [> ] 11/287, 0.2 task/s, elapsed: 67s, ETA: 1689s [> ] 12/287, 0.2 task/s, elapsed: 67s, ETA: 1543s [> ] 13/287, 0.2 task/s, elapsed: 67s, ETA: 1419s [> ] 14/287, 0.2 task/s, elapsed: 67s, ETA: 1314s [> ] 15/287, 0.2 task/s, elapsed: 67s, ETA: 1222s [> ] 16/287, 0.2 task/s, elapsed: 67s, ETA: 1142s [> ] 17/287, 0.3 task/s, elapsed: 67s, ETA: 1071s [> ] 18/287, 0.3 task/s, elapsed: 67s, ETA: 1007s [>> ] 19/287, 0.3 task/s, elapsed: 67s, ETA: 951s [>> ] 20/287, 0.3 task/s, elapsed: 67s, ETA: 900s [>> ] 21/287, 0.3 task/s, elapsed: 67s, ETA: 854s [>> ] 22/287, 0.3 task/s, elapsed: 67s, ETA: 812s [>> ] 23/287, 0.3 task/s, elapsed: 67s, ETA: 774s [>> ] 24/287, 0.4 task/s, elapsed: 67s, ETA: 739s [>> ] 25/287, 0.4 task/s, elapsed: 67s, ETA: 707s [>> ] 26/287, 0.4 task/s, elapsed: 67s, ETA: 677s [>> ] 27/287, 0.4 task/s, elapsed: 67s, ETA: 649s [>>> ] 28/287, 0.4 task/s, elapsed: 67s, ETA: 624s [>>> ] 29/287, 0.4 task/s, elapsed: 67s, ETA: 600s [>>> ] 30/287, 0.4 task/s, elapsed: 67s, ETA: 578s [>>> ] 31/287, 0.5 task/s, elapsed: 67s, ETA: 557s [>>> ] 32/287, 0.5 task/s, elapsed: 68s, ETA: 539s [>>> ] 33/287, 0.4 task/s, elapsed: 87s, ETA: 670s [>>> ] 34/287, 0.4 task/s, elapsed: 87s, ETA: 648s [>>> ] 35/287, 0.4 task/s, elapsed: 87s, ETA: 627s [>>> ] 36/287, 0.4 task/s, elapsed: 87s, ETA: 608s [>>> ] 37/287, 0.4 task/s, elapsed: 87s, ETA: 590s [>>>> ] 38/287, 0.4 task/s, elapsed: 87s, ETA: 572s [>>>> ] 39/287, 0.4 task/s, elapsed: 87s, ETA: 555s [>>>> ] 40/287, 0.5 task/s, elapsed: 88s, ETA: 541s [>>>> ] 41/287, 0.5 task/s, elapsed: 88s, ETA: 526s [>>>> ] 42/287, 0.5 task/s, elapsed: 88s, ETA: 512s [>>>> ] 43/287, 0.5 task/s, elapsed: 88s, ETA: 498s [>>>> ] 44/287, 0.5 task/s, elapsed: 88s, ETA: 485s [>>>> ] 45/287, 0.5 task/s, elapsed: 88s, ETA: 473s [>>>> ] 46/287, 0.5 task/s, elapsed: 88s, ETA: 462s [>>>>> ] 47/287, 0.5 task/s, elapsed: 88s, ETA: 451s [>>>>> ] 48/287, 0.5 task/s, elapsed: 89s, ETA: 441s [>>>>> ] 49/287, 0.6 task/s, elapsed: 89s, ETA: 431s [>>>>> ] 50/287, 0.6 task/s, elapsed: 90s, ETA: 429s [>>>>> ] 51/287, 0.6 task/s, elapsed: 91s, ETA: 419s [>>>>> ] 52/287, 0.6 task/s, elapsed: 91s, ETA: 410s [>>>>> ] 53/287, 0.6 task/s, elapsed: 91s, ETA: 401s [>>>>> ] 54/287, 0.6 task/s, elapsed: 91s, ETA: 392s [>>>>> ] 55/287, 0.6 task/s, elapsed: 91s, ETA: 384s [>>>>>> ] 56/287, 0.6 task/s, elapsed: 91s, ETA: 375s [>>>>>> ] 57/287, 0.6 task/s, elapsed: 91s, ETA: 368s [>>>>>> ] 58/287, 0.6 task/s, elapsed: 92s, ETA: 365s [>>>>>> ] 59/287, 0.6 task/s, elapsed: 92s, ETA: 357s [>>>>>> ] 60/287, 0.6 task/s, elapsed: 93s, ETA: 351s [>>>>>> ] 61/287, 0.7 task/s, elapsed: 94s, ETA: 347s [>>>>>> ] 62/287, 0.7 task/s, elapsed: 94s, ETA: 340s [>>>>>> ] 63/287, 0.7 task/s, elapsed: 94s, ETA: 334s [>>>>>> ] 64/287, 0.7 task/s, elapsed: 94s, ETA: 327s [>>>>>> ] 65/287, 0.6 task/s, elapsed: 105s, ETA: 360s [>>>>>> ] 66/287, 0.6 task/s, elapsed: 105s, ETA: 353s [>>>>>>> ] 67/287, 0.6 task/s, elapsed: 106s, ETA: 347s [>>>>>>> ] 68/287, 0.6 task/s, elapsed: 106s, ETA: 343s [>>>>>>> ] 69/287, 0.6 task/s, elapsed: 107s, ETA: 337s [>>>>>>> ] 70/287, 0.7 task/s, elapsed: 107s, ETA: 332s [>>>>>>> ] 71/287, 0.7 task/s, elapsed: 108s, ETA: 328s [>>>>>>> ] 72/287, 0.7 task/s, elapsed: 108s, ETA: 323s [>>>>>>> ] 73/287, 0.7 task/s, elapsed: 108s, ETA: 318s [>>>>>>> ] 74/287, 0.7 task/s, elapsed: 109s, ETA: 313s [>>>>>>> ] 75/287, 0.7 task/s, elapsed: 109s, ETA: 308s [>>>>>>> ] 76/287, 0.7 task/s, elapsed: 110s, ETA: 305s [>>>>>>>> ] 77/287, 0.7 task/s, elapsed: 110s, ETA: 300s [>>>>>>>> ] 78/287, 0.7 task/s, elapsed: 111s, ETA: 298s [>>>>>>>> ] 79/287, 0.7 task/s, elapsed: 111s, ETA: 292s [>>>>>>>> ] 80/287, 0.7 task/s, elapsed: 111s, ETA: 288s [>>>>>>>> ] 81/287, 0.7 task/s, elapsed: 111s, ETA: 283s [>>>>>>>> ] 82/287, 0.7 task/s, elapsed: 112s, ETA: 281s [>>>>>>>> ] 83/287, 0.7 task/s, elapsed: 112s, ETA: 276s [>>>>>>>> ] 84/287, 0.7 task/s, elapsed: 112s, ETA: 272s [>>>>>>>> ] 85/287, 0.8 task/s, elapsed: 113s, ETA: 269s [>>>>>>>> ] 86/287, 0.8 task/s, elapsed: 113s, ETA: 265s [>>>>>>>>> ] 87/287, 0.8 task/s, elapsed: 113s, ETA: 261s [>>>>>>>>> ] 88/287, 0.8 task/s, elapsed: 114s, ETA: 257s [>>>>>>>>> ] 89/287, 0.8 task/s, elapsed: 114s, ETA: 254s [>>>>>>>>> ] 90/287, 0.8 task/s, elapsed: 115s, ETA: 251s [>>>>>>>>> ] 91/287, 0.8 task/s, elapsed: 115s, ETA: 247s [>>>>>>>>> ] 92/287, 0.8 task/s, elapsed: 115s, ETA: 243s [>>>>>>>>> ] 93/287, 0.8 task/s, elapsed: 115s, ETA: 240s [>>>>>>>>> ] 94/287, 0.8 task/s, elapsed: 116s, ETA: 237s [>>>>>>>>> ] 95/287, 0.8 task/s, elapsed: 119s, ETA: 241s [>>>>>>>>>> ] 96/287, 0.8 task/s, elapsed: 119s, ETA: 237s [>>>>>>>>>> ] 97/287, 0.8 task/s, elapsed: 124s, ETA: 244s [>>>>>>>>>> ] 98/287, 0.8 task/s, elapsed: 125s, ETA: 240s [>>>>>>>>>> ] 99/287, 0.8 task/s, elapsed: 125s, ETA: 237s [>>>>>>>>>> ] 100/287, 0.8 task/s, elapsed: 127s, ETA: 237s [>>>>>>>>>> ] 101/287, 0.8 task/s, elapsed: 127s, ETA: 234s [>>>>>>>>>> ] 102/287, 0.8 task/s, elapsed: 127s, ETA: 231s [>>>>>>>>>> ] 103/287, 0.8 task/s, elapsed: 127s, ETA: 227s [>>>>>>>>>> ] 104/287, 0.8 task/s, elapsed: 127s, ETA: 224s [>>>>>>>>>> ] 105/287, 0.8 task/s, elapsed: 128s, ETA: 223s [>>>>>>>>>> ] 106/287, 0.8 task/s, elapsed: 132s, ETA: 226s [>>>>>>>>>> ] 107/287, 0.8 task/s, elapsed: 132s, ETA: 223s [>>>>>>>>>> ] 108/287, 0.8 task/s, elapsed: 132s, ETA: 220s [>>>>>>>>>>> ] 109/287, 0.8 task/s, elapsed: 134s, ETA: 219s [>>>>>>>>>>> ] 110/287, 0.8 task/s, elapsed: 134s, ETA: 216s [>>>>>>>>>>> ] 111/287, 0.8 task/s, elapsed: 134s, ETA: 213s [>>>>>>>>>>> ] 112/287, 0.8 task/s, elapsed: 135s, ETA: 210s [>>>>>>>>>>> ] 113/287, 0.8 task/s, elapsed: 135s, ETA: 208s [>>>>>>>>>>> ] 114/287, 0.8 task/s, elapsed: 135s, ETA: 205s [>>>>>>>>>>> ] 115/287, 0.9 task/s, elapsed: 135s, ETA: 202s [>>>>>>>>>>> ] 116/287, 0.9 task/s, elapsed: 135s, ETA: 199s [>>>>>>>>>>> ] 117/287, 0.9 task/s, elapsed: 136s, ETA: 198s [>>>>>>>>>>> ] 118/287, 0.9 task/s, elapsed: 136s, ETA: 195s [>>>>>>>>>>>> ] 119/287, 0.9 task/s, elapsed: 137s, ETA: 193s [>>>>>>>>>>>> ] 120/287, 0.9 task/s, elapsed: 138s, ETA: 192s [>>>>>>>>>>>> ] 121/287, 0.9 task/s, elapsed: 138s, ETA: 189s [>>>>>>>>>>>> ] 122/287, 0.9 task/s, elapsed: 138s, ETA: 187s [>>>>>>>>>>>> ] 123/287, 0.9 task/s, elapsed: 139s, ETA: 185s [>>>>>>>>>>>> ] 124/287, 0.9 task/s, elapsed: 139s, ETA: 183s [>>>>>>>>>>>> ] 125/287, 0.9 task/s, elapsed: 139s, ETA: 180s [>>>>>>>>>>>> ] 126/287, 0.9 task/s, elapsed: 141s, ETA: 180s [>>>>>>>>>>>> ] 127/287, 0.9 task/s, elapsed: 142s, ETA: 179s [>>>>>>>>>>>> ] 128/287, 0.9 task/s, elapsed: 143s, ETA: 177s [>>>>>>>>>>>>> ] 129/287, 0.9 task/s, elapsed: 145s, ETA: 177s [>>>>>>>>>>>>> ] 130/287, 0.9 task/s, elapsed: 145s, ETA: 175s [>>>>>>>>>>>>> ] 131/287, 0.9 task/s, elapsed: 145s, ETA: 172s [>>>>>>>>>>>>> ] 132/287, 0.9 task/s, elapsed: 149s, ETA: 175s [>>>>>>>>>>>>> ] 133/287, 0.9 task/s, elapsed: 149s, ETA: 173s [>>>>>>>>>>>>> ] 134/287, 0.9 task/s, elapsed: 149s, ETA: 170s [>>>>>>>>>>>>> ] 135/287, 0.9 task/s, elapsed: 149s, ETA: 168s [>>>>>>>>>>>>> ] 136/287, 0.9 task/s, elapsed: 150s, ETA: 166s [>>>>>>>>>>>>> ] 137/287, 0.9 task/s, elapsed: 152s, ETA: 166s [>>>>>>>>>>>>> ] 138/287, 0.9 task/s, elapsed: 152s, ETA: 165s [>>>>>>>>>>>>>> ] 139/287, 0.9 task/s, elapsed: 152s, ETA: 162s [>>>>>>>>>>>>>> ] 140/287, 0.9 task/s, elapsed: 153s, ETA: 161s [>>>>>>>>>>>>>> ] 141/287, 0.9 task/s, elapsed: 153s, ETA: 159s [>>>>>>>>>>>>>> ] 142/287, 0.9 task/s, elapsed: 154s, ETA: 157s [>>>>>>>>>>>>>> ] 143/287, 0.9 task/s, elapsed: 154s, ETA: 155s [>>>>>>>>>>>>>> ] 144/287, 0.9 task/s, elapsed: 155s, ETA: 154s [>>>>>>>>>>>>>> ] 145/287, 0.9 task/s, elapsed: 155s, ETA: 152s [>>>>>>>>>>>>>> ] 146/287, 0.9 task/s, elapsed: 155s, ETA: 150s [>>>>>>>>>>>>>> ] 147/287, 0.9 task/s, elapsed: 155s, ETA: 148s [>>>>>>>>>>>>>> ] 148/287, 1.0 task/s, elapsed: 155s, ETA: 146s [>>>>>>>>>>>>>>> ] 149/287, 0.9 task/s, elapsed: 157s, ETA: 146s [>>>>>>>>>>>>>>> ] 150/287, 1.0 task/s, elapsed: 157s, ETA: 144s [>>>>>>>>>>>>>>> ] 151/287, 1.0 task/s, elapsed: 158s, ETA: 143s [>>>>>>>>>>>>>>> ] 152/287, 0.9 task/s, elapsed: 160s, ETA: 142s [>>>>>>>>>>>>>>> ] 153/287, 1.0 task/s, elapsed: 160s, ETA: 140s [>>>>>>>>>>>>>>> ] 154/287, 1.0 task/s, elapsed: 160s, ETA: 139s [>>>>>>>>>>>>>>> ] 155/287, 1.0 task/s, elapsed: 161s, ETA: 137s [>>>>>>>>>>>>>>> ] 156/287, 1.0 task/s, elapsed: 163s, ETA: 137s [>>>>>>>>>>>>>>> ] 157/287, 1.0 task/s, elapsed: 163s, ETA: 135s [>>>>>>>>>>>>>>> ] 158/287, 1.0 task/s, elapsed: 164s, ETA: 134s [>>>>>>>>>>>>>>>> ] 159/287, 1.0 task/s, elapsed: 166s, ETA: 133s [>>>>>>>>>>>>>>>> ] 160/287, 1.0 task/s, elapsed: 166s, ETA: 131s [>>>>>>>>>>>>>>>> ] 161/287, 1.0 task/s, elapsed: 168s, ETA: 132s [>>>>>>>>>>>>>>>> ] 162/287, 1.0 task/s, elapsed: 168s, ETA: 130s [>>>>>>>>>>>>>>>> ] 163/287, 1.0 task/s, elapsed: 168s, ETA: 128s [>>>>>>>>>>>>>>>> ] 164/287, 1.0 task/s, elapsed: 169s, ETA: 127s [>>>>>>>>>>>>>>>> ] 165/287, 1.0 task/s, elapsed: 171s, ETA: 126s [>>>>>>>>>>>>>>>> ] 166/287, 1.0 task/s, elapsed: 171s, ETA: 124s [>>>>>>>>>>>>>>>> ] 167/287, 1.0 task/s, elapsed: 171s, ETA: 123s [>>>>>>>>>>>>>>>> ] 168/287, 1.0 task/s, elapsed: 171s, ETA: 121s [>>>>>>>>>>>>>>>>> ] 169/287, 1.0 task/s, elapsed: 172s, ETA: 120s [>>>>>>>>>>>>>>>>> ] 170/287, 1.0 task/s, elapsed: 172s, ETA: 119s [>>>>>>>>>>>>>>>>> ] 171/287, 1.0 task/s, elapsed: 175s, ETA: 118s [>>>>>>>>>>>>>>>>> ] 172/287, 1.0 task/s, elapsed: 176s, ETA: 117s [>>>>>>>>>>>>>>>>> ] 173/287, 1.0 task/s, elapsed: 176s, ETA: 116s [>>>>>>>>>>>>>>>>> ] 174/287, 1.0 task/s, elapsed: 176s, ETA: 114s [>>>>>>>>>>>>>>>>> ] 175/287, 1.0 task/s, elapsed: 176s, ETA: 113s [>>>>>>>>>>>>>>>>> ] 176/287, 1.0 task/s, elapsed: 177s, ETA: 112s [>>>>>>>>>>>>>>>>> ] 177/287, 1.0 task/s, elapsed: 177s, ETA: 110s [>>>>>>>>>>>>>>>>> ] 178/287, 1.0 task/s, elapsed: 178s, ETA: 109s [>>>>>>>>>>>>>>>>>> ] 179/287, 1.0 task/s, elapsed: 178s, ETA: 107s [>>>>>>>>>>>>>>>>>> ] 180/287, 1.0 task/s, elapsed: 178s, ETA: 106s [>>>>>>>>>>>>>>>>>> ] 181/287, 1.0 task/s, elapsed: 179s, ETA: 105s [>>>>>>>>>>>>>>>>>> ] 182/287, 1.0 task/s, elapsed: 179s, ETA: 103s [>>>>>>>>>>>>>>>>>> ] 183/287, 1.0 task/s, elapsed: 180s, ETA: 103s [>>>>>>>>>>>>>>>>>> ] 184/287, 1.0 task/s, elapsed: 180s, ETA: 101s [>>>>>>>>>>>>>>>>>> ] 185/287, 1.0 task/s, elapsed: 183s, ETA: 101s [>>>>>>>>>>>>>>>>>> ] 186/287, 1.0 task/s, elapsed: 184s, ETA: 100s [>>>>>>>>>>>>>>>>>> ] 187/287, 1.0 task/s, elapsed: 184s, ETA: 99s [>>>>>>>>>>>>>>>>>> ] 188/287, 1.0 task/s, elapsed: 185s, ETA: 97s [>>>>>>>>>>>>>>>>>>> ] 189/287, 1.0 task/s, elapsed: 188s, ETA: 97s [>>>>>>>>>>>>>>>>>>> ] 190/287, 1.0 task/s, elapsed: 188s, ETA: 96s [>>>>>>>>>>>>>>>>>>> ] 191/287, 1.0 task/s, elapsed: 188s, ETA: 95s [>>>>>>>>>>>>>>>>>>> ] 192/287, 1.0 task/s, elapsed: 190s, ETA: 94s [>>>>>>>>>>>>>>>>>>> ] 193/287, 1.0 task/s, elapsed: 190s, ETA: 92s [>>>>>>>>>>>>>>>>>>> ] 194/287, 1.0 task/s, elapsed: 190s, ETA: 91s [>>>>>>>>>>>>>>>>>>> ] 195/287, 1.0 task/s, elapsed: 191s, ETA: 90s [>>>>>>>>>>>>>>>>>>> ] 196/287, 1.0 task/s, elapsed: 191s, ETA: 89s [>>>>>>>>>>>>>>>>>>> ] 197/287, 1.0 task/s, elapsed: 192s, ETA: 88s [>>>>>>>>>>>>>>>>>>>> ] 198/287, 1.0 task/s, elapsed: 192s, ETA: 86s [>>>>>>>>>>>>>>>>>>>> ] 199/287, 1.0 task/s, elapsed: 193s, ETA: 85s [>>>>>>>>>>>>>>>>>>>> ] 200/287, 1.0 task/s, elapsed: 193s, ETA: 84s [>>>>>>>>>>>>>>>>>>>> ] 201/287, 1.0 task/s, elapsed: 193s, ETA: 83s [>>>>>>>>>>>>>>>>>>>> ] 202/287, 1.0 task/s, elapsed: 195s, ETA: 82s [>>>>>>>>>>>>>>>>>>>> ] 203/287, 1.0 task/s, elapsed: 195s, ETA: 81s [>>>>>>>>>>>>>>>>>>>> ] 204/287, 1.0 task/s, elapsed: 195s, ETA: 79s [>>>>>>>>>>>>>>>>>>>> ] 205/287, 1.0 task/s, elapsed: 196s, ETA: 79s [>>>>>>>>>>>>>>>>>>>> ] 206/287, 1.0 task/s, elapsed: 197s, ETA: 77s [>>>>>>>>>>>>>>>>>>>> ] 207/287, 1.0 task/s, elapsed: 198s, ETA: 76s [>>>>>>>>>>>>>>>>>>>>> ] 208/287, 1.0 task/s, elapsed: 199s, ETA: 76s [>>>>>>>>>>>>>>>>>>>>> ] 209/287, 1.0 task/s, elapsed: 201s, ETA: 75s [>>>>>>>>>>>>>>>>>>>>> ] 210/287, 1.0 task/s, elapsed: 201s, ETA: 74s [>>>>>>>>>>>>>>>>>>>>> ] 211/287, 1.0 task/s, elapsed: 202s, ETA: 73s [>>>>>>>>>>>>>>>>>>>>> ] 212/287, 1.0 task/s, elapsed: 203s, ETA: 72s [>>>>>>>>>>>>>>>>>>>>> ] 213/287, 1.0 task/s, elapsed: 203s, ETA: 71s [>>>>>>>>>>>>>>>>>>>>> ] 214/287, 1.1 task/s, elapsed: 203s, ETA: 69s [>>>>>>>>>>>>>>>>>>>>> ] 215/287, 1.1 task/s, elapsed: 203s, ETA: 68s [>>>>>>>>>>>>>>>>>>>>> ] 216/287, 1.1 task/s, elapsed: 205s, ETA: 67s [>>>>>>>>>>>>>>>>>>>>> ] 217/287, 1.1 task/s, elapsed: 205s, ETA: 66s [>>>>>>>>>>>>>>>>>>>>>> ] 218/287, 1.1 task/s, elapsed: 205s, ETA: 65s [>>>>>>>>>>>>>>>>>>>>>> ] 219/287, 1.1 task/s, elapsed: 208s, ETA: 65s [>>>>>>>>>>>>>>>>>>>>>> ] 220/287, 1.1 task/s, elapsed: 209s, ETA: 64s [>>>>>>>>>>>>>>>>>>>>>> ] 221/287, 1.1 task/s, elapsed: 209s, ETA: 62s [>>>>>>>>>>>>>>>>>>>>>> ] 222/287, 1.1 task/s, elapsed: 209s, ETA: 61s [>>>>>>>>>>>>>>>>>>>>>> ] 223/287, 1.1 task/s, elapsed: 209s, ETA: 60s [>>>>>>>>>>>>>>>>>>>>>> ] 224/287, 1.1 task/s, elapsed: 210s, ETA: 59s [>>>>>>>>>>>>>>>>>>>>>> ] 225/287, 1.1 task/s, elapsed: 211s, ETA: 58s [>>>>>>>>>>>>>>>>>>>>>> ] 226/287, 1.1 task/s, elapsed: 211s, ETA: 57s [>>>>>>>>>>>>>>>>>>>>>> ] 227/287, 1.1 task/s, elapsed: 211s, ETA: 56s [>>>>>>>>>>>>>>>>>>>>>>> ] 228/287, 1.1 task/s, elapsed: 211s, ETA: 55s [>>>>>>>>>>>>>>>>>>>>>>> ] 229/287, 1.1 task/s, elapsed: 212s, ETA: 54s [>>>>>>>>>>>>>>>>>>>>>>> ] 230/287, 1.1 task/s, elapsed: 216s, ETA: 54s [>>>>>>>>>>>>>>>>>>>>>>> ] 231/287, 1.1 task/s, elapsed: 216s, ETA: 52s [>>>>>>>>>>>>>>>>>>>>>>> ] 232/287, 1.1 task/s, elapsed: 216s, ETA: 51s [>>>>>>>>>>>>>>>>>>>>>>> ] 233/287, 1.1 task/s, elapsed: 217s, ETA: 50s [>>>>>>>>>>>>>>>>>>>>>>> ] 234/287, 1.1 task/s, elapsed: 218s, ETA: 49s [>>>>>>>>>>>>>>>>>>>>>>> ] 235/287, 1.1 task/s, elapsed: 218s, ETA: 48s [>>>>>>>>>>>>>>>>>>>>>>> ] 236/287, 1.1 task/s, elapsed: 218s, ETA: 47s [>>>>>>>>>>>>>>>>>>>>>>> ] 237/287, 1.1 task/s, elapsed: 219s, ETA: 46s [>>>>>>>>>>>>>>>>>>>>>>>> ] 238/287, 1.1 task/s, elapsed: 220s, ETA: 45s [>>>>>>>>>>>>>>>>>>>>>>>> ] 239/287, 1.1 task/s, elapsed: 220s, ETA: 44s [>>>>>>>>>>>>>>>>>>>>>>>> ] 240/287, 1.1 task/s, elapsed: 220s, ETA: 43s [>>>>>>>>>>>>>>>>>>>>>>>> ] 241/287, 1.1 task/s, elapsed: 220s, ETA: 42s [>>>>>>>>>>>>>>>>>>>>>>>> ] 242/287, 1.1 task/s, elapsed: 221s, ETA: 41s [>>>>>>>>>>>>>>>>>>>>>>>> ] 243/287, 1.1 task/s, elapsed: 222s, ETA: 40s [>>>>>>>>>>>>>>>>>>>>>>>> ] 244/287, 1.1 task/s, elapsed: 224s, ETA: 39s [>>>>>>>>>>>>>>>>>>>>>>>> ] 245/287, 1.1 task/s, elapsed: 224s, ETA: 38s [>>>>>>>>>>>>>>>>>>>>>>>> ] 246/287, 1.1 task/s, elapsed: 224s, ETA: 37s [>>>>>>>>>>>>>>>>>>>>>>>> ] 247/287, 1.1 task/s, elapsed: 226s, ETA: 37s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 248/287, 1.1 task/s, elapsed: 227s, ETA: 36s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 249/287, 1.1 task/s, elapsed: 227s, ETA: 35s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 250/287, 1.1 task/s, elapsed: 227s, ETA: 34s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 251/287, 1.1 task/s, elapsed: 228s, ETA: 33s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 252/287, 1.1 task/s, elapsed: 229s, ETA: 32s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 253/287, 1.1 task/s, elapsed: 230s, ETA: 31s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 254/287, 1.1 task/s, elapsed: 231s, ETA: 30s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 255/287, 1.1 task/s, elapsed: 231s, ETA: 29s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 256/287, 1.1 task/s, elapsed: 232s, ETA: 28s [>>>>>>>>>>>>>>>>>>>>>>>>> ] 257/287, 1.1 task/s, elapsed: 233s, ETA: 27s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 258/287, 1.1 task/s, elapsed: 234s, ETA: 26s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 259/287, 1.1 task/s, elapsed: 234s, ETA: 25s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 260/287, 1.1 task/s, elapsed: 234s, ETA: 24s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 261/287, 1.1 task/s, elapsed: 234s, ETA: 23s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 262/287, 1.1 task/s, elapsed: 234s, ETA: 22s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 263/287, 1.1 task/s, elapsed: 234s, ETA: 21s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 264/287, 1.1 task/s, elapsed: 235s, ETA: 20s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 265/287, 1.1 task/s, elapsed: 235s, ETA: 20s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 266/287, 1.1 task/s, elapsed: 235s, ETA: 19s [>>>>>>>>>>>>>>>>>>>>>>>>>> ] 267/287, 1.1 task/s, elapsed: 237s, ETA: 18s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 268/287, 1.1 task/s, elapsed: 237s, ETA: 17s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 269/287, 1.1 task/s, elapsed: 238s, ETA: 16s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 270/287, 1.1 task/s, elapsed: 240s, ETA: 15s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 271/287, 1.1 task/s, elapsed: 241s, ETA: 14s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 272/287, 1.1 task/s, elapsed: 241s, ETA: 13s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 273/287, 1.1 task/s, elapsed: 241s, ETA: 12s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 274/287, 1.1 task/s, elapsed: 242s, ETA: 12s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 275/287, 1.1 task/s, elapsed: 243s, ETA: 11s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 276/287, 1.1 task/s, elapsed: 244s, ETA: 10s [>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 277/287, 1.1 task/s, elapsed: 244s, ETA: 9s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 278/287, 1.1 task/s, elapsed: 245s, ETA: 8s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 279/287, 1.1 task/s, elapsed: 246s, ETA: 7s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 280/287, 1.1 task/s, elapsed: 248s, ETA: 6s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 281/287, 1.1 task/s, elapsed: 248s, ETA: 5s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 282/287, 1.1 task/s, elapsed: 248s, ETA: 4s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 283/287, 1.1 task/s, elapsed: 250s, ETA: 4s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 284/287, 1.1 task/s, elapsed: 255s, ETA: 3s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 285/287, 1.1 task/s, elapsed: 257s, ETA: 2s [>>>>>>>>>>>>>>>>>>>>>>>>>>>> ] 286/287, 0.7 task/s, elapsed: 420s, ETA: 1s [>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 287/287, 0.7 task/s, elapsed: 432s, ETA: 0s
dataset version metric mode internvl-chat-20b
---------------------------- --------- ---------------------------- ------ -------------------
mmlu - naive_average gen 50.51
cmmlu - naive_average gen 62.65
ceval - naive_average gen 60.44
agieval - - - -
GaokaoBench - weighted_average gen 54.68
triviaqa 2121ce score gen 32.33
triviaqa_wiki_1shot - - - -
nq 3dcea1 score gen 10.14
C3 8c358f accuracy gen 61.42
race-high 9a54b6 accuracy gen 78.53
flores_100 - - - -
winogrande b36770 accuracy gen 56.91
hellaswag e42710 accuracy gen 76.19
bbh - naive_average gen 43.36
gsm8k 1d7fe4 accuracy gen 53.30
math 393424 accuracy gen 39.52
TheoremQA 6f0af8 score gen 11.38
MathBench - - - -
openai_humaneval 8e312c humaneval_pass@1 gen 41.46
humanevalx - - - -
sanitized_mbpp a447ff score gen 42.80
mbpp_cn 6fb572 score gen 33.80
leval - - - -
leval_closed - - - -
leval_open - - - -
longbench - - - -
longbench_single-document-qa - - - -
longbench_multi-document-qa - - - -
longbench_summarization - - - -
longbench_few-shot-learning - - - -
longbench_synthetic-tasks - - - -
longbench_code-completion - - - -
teval - - - -
teval_zh - - - -
IFEval 3321a3 Prompt-level-strict-accuracy gen 31.24
IFEval 3321a3 Inst-level-strict-accuracy gen 42.33
IFEval 3321a3 Prompt-level-loose-accuracy gen 34.75
IFEval 3321a3 Inst-level-loose-accuracy gen 45.80
09/21 21:20:41 - OpenCompass - INFO - write summary to /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/work_dirs/internvl_chat_v2_5/internvl_chat_v2_5_internlm2_1_8b_dynamic_res_pretrain/checkpoint-33200/20240921_194627/summary/summary_20240921_194627.txt
09/21 21:20:41 - OpenCompass - INFO - write csv to /mnt/petrelfs/wangweiyun/workspace_cz/InternVL/internvl_chat_dev/work_dirs/internvl_chat_v2_5/internvl_chat_v2_5_internlm2_1_8b_dynamic_res_pretrain/checkpoint-33200/20240921_194627/summary/summary_20240921_194627.csv