V-STaR commited on
Commit
8038ceb
·
verified ·
1 Parent(s): d4e8d2a

Upload 3 files

Browse files
leaderboard_chain1.csv ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
+ GPT-4o,1.71,60.78,23.14,10.35,5.10,16.67,19.92,8.36,2.75,6.47,39.51,27.97
3
+ Gemini-2-Flash,1.59,53.01,31.63,15.84,9.45,24.54,15.67,3.82,0.93,4.63,36.14,27.39
4
+ Video-Llama3,1.38,41.94,35.73,19.80,8.68,22.97,3.17,0.76,0.11,0.89,27.12,21.93
5
+ Qwen2.5-VL,1.61,54.53,17.03,8.92,3.72,11.48,35.89,19.92,8.36,13.59,35.20,26.53
6
+ Qwen2-VL,1.03,25.91,27.96,17.94,9.16,19.18,28.59,12.21,3.89,9.31,20.35,18.13
7
+ InternVL-2.5,1.46,44.18,11.98,4.87,2.34,8.72,2.18,0.27,0.04,0.65,22.69,17.85
8
+ Llava-Video,1.50,49.48,15.12,6.30,1.43,10.52,5.23,0.94,0.18,1.92,27.11,20.64
9
+ VideoChat2,1.27,36.21,20.47,13.07,6.49,13.69,10.06,1.31,0.14,2.51,20.74,17.47
10
+ Oryx-1.5,0.94,20.47,17.03,4.48,1.72,13.54,35.58,11.60,2.17,10.14,16.05,14.72
11
+ Video-CCAM-v1.2,1.75,59.35,1.15,0.00,0.00,1.50,0.00,0.00,0.00,0.00,30.51,20.28
12
+ TimeChat,1.06,26.38,17.80,8.68,3.48,12.01,0.00,0.00,0.00,0.00,14.47,12.80
13
+ VTimeLLM,1.45,41.46,25.24,10.88,3.15,17.13,0.62,0.14,0.03,0.21,24.18,19.60
14
+ TRACE,0.90,17.60,28.53,14.17,6.73,19.74,0.00,0.00,0.00,0.00,13.78,12.45
15
+ Sa2VA,0.70,16.36,0.10,0.00,0.00,0.11,52.16,42.68,34.18,32.31,19.00,16.26
leaderboard_chain2.csv ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
+ GPT-4o,1.71,60.78,9.29,4.18,1.19,3.01,17.13,10.04,7.25,12.82,36.79,25.53
3
+ Gemini-2-Flash,1.59,53.01,7.49,1.89,0.58,2.21,31.58,15.22,8.54,23.83,34.99,26.35
4
+ Video-Llama3,1.38,41.94,0.62,0.17,0.02,0.19,35.11,20.42,9.21,23.14,26.96,21.76
5
+ Qwen2.5-VL,1.61,54.53,5.15,2.87,1.40,2.00,11.02,5.39,2.48,7.61,29.58,21.38
6
+ Qwen2-VL,1.03,25.91,7.11,3.55,1.14,2.41,24.62,16.32,8.25,17.52,17.23,15.28
7
+ InternVL-2.5,1.46,44.18,0.42,0.03,0.00,0.14,10.83,3.77,1.57,7.75,27.15,17.36
8
+ Llava-Video,1.50,49.48,4.29,1.23,0.25,1.31,16.89,5.49,2.00,12.21,27.54,21.00
9
+ VideoChat2,1.27,36.21,3.08,0.91,0.30,0.97,18.08,12.07,6.20,12.50,19.77,16.56
10
+ Oryx-1.5,0.94,20.47,11.50,4.32,0.96,3.50,18.99,5.58,2.72,14.81,14.16,12.93
11
+ Video-CCAM-v1.2,1.75,59.35,0.00,0.00,0.00,0.00,2.19,0.00,0.00,2.26,30.88,20.54
12
+ TimeChat,1.06,26.38,0.00,0.00,0.00,0.00,20.42,8.54,2.53,13.60,15.08,13.33
13
+ VTimeLLM,1.45,41.46,0.00,0.00,0.00,0.00,8.44,4.53,2.10,5.96,19.90,15.81
14
+ TRACE,0.90,17.60,0.00,0.00,0.00,0.00,24.52,12.02,5.73,17.11,12.71,11.57
15
+ Sa2VA,0.70,16.36,58.47,49.47,40.42,37.48,0.00,0.00,0.00,0.00,21.61,17.95
leaderboard_main.csv ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Model,Short,,Medium,,Long,,All,
2
+ ,mAM,mLGM,mAM,mLGM,mAM,mLGM,mAM,mLGM
3
+ GPT-4o,27.49,38.56,26.96,40.58,14.86,19.28,26.75,38.15
4
+ Gemini-2-Flash,24.97,32.07,28.99,40.35,37.81,56.14,26.87,35.57
5
+ Video-Llama3,21.68,26.62,21.84,27.23,22.46,28.83,21.66,27.04
6
+ Qwen2.5-VL,25.51,34.84,23.67,32.87,2.2,2.27,23.96,32.39
7
+ Qwen2-VL,15.78,17.5,18.47,21.22,14.09,17.53,16.71,18.79
8
+ InternVL-2.5,17.94,22.9,17.94,23.06,9.58,11.19,17.6,24.92
9
+ Llava-Video,22.37,30.23,18.28,22.77,18.23,25.23,20.82,27.33
10
+ VideoChat2,17.57,21.02,17.2,20.5,5.28,5.64,17.02,20.26
11
+ Oryx-1.5,13.17,14.25,14.83,16.46,11.89,13.99,15.11,13.83
12
+ Video-CCAM-v1.2,21.66,34.09,19.62,28.36,12.61,15.8,20.41,30.7
13
+ TimeChat,13.7,15.56,13.22,15.06,3.24,3.37,13.07,14.78
14
+ VTimeLLM,18.31,23.19,18.15,22.44,5.52,5.89,17.71,22.04
15
+ TRACE,11.77,12.96,12.49,13.87,13.59,15.3,12.01,13.25
16
+ Sa2VA,18.14,22.01,16.32,18.92,8.85,9.7,17.11,20.31