Spaces:
Running
on
Zero
Running
on
Zero
Commit
·
4726535
1
Parent(s):
891099e
Auto Daily Leaderboard udpate Sun Mar 2 12:00:34 PM EST 2025
Browse files- arena_elo/results/20250302/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20250302/clean_battle_video_generation.json +0 -0
- arena_elo/results/20250302/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20250302/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20250302/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/20250302/video_generation_leaderboard.csv +16 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +14 -0
- arena_elo/results/latest/clean_battle_video_generation.json +42 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
- arena_elo/results/latest/video_generation_leaderboard.csv +15 -15
arena_elo/results/20250302/clean_battle_t2i_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20250302/clean_battle_video_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20250302/elo_results_t2i_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:63dbf15aa26b8b2b369373df116d1d24d987f712081d20692da094f5f5b27d95
|
3 |
+
size 88249
|
arena_elo/results/20250302/elo_results_video_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0681d8e3f8ce34f2d20de90413387e905ecda5bd8b09387e6922c0ca3d73f4a6
|
3 |
+
size 81355
|
arena_elo/results/20250302/t2i_generation_leaderboard.csv
ADDED
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FLUX.1-dev,FLUX.1-dev,1142.112390379867,1138.3047211898725,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
3 |
+
PlayGround V2.5,PlayGround V2.5,1114.2417276451602,1117.248545391814,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
4 |
+
FLUX.1-schnell,FLUX.1-schnell,1095.2118164933304,1099.2642394085974,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
5 |
+
PlayGround V2,PlayGround V2,1070.9945288850886,1071.3626819356546,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
Kolors,Kolors,1060.0208684082033,1058.8848691929727,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
7 |
+
StableCascade,StableCascade,1042.150437254075,1045.044371277998,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
HunyuanDiT,HunyuanDiT,1020.0885444105875,1015.2227870100409,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
9 |
+
PixArtAlpha,PixArtAlpha,1018.631588065109,1011.6650123985901,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
10 |
+
PixArtSigma,PixArtSigma,1016.9713248537824,1017.8074215819955,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
11 |
+
SDXL-Lightning,SDXL-Lightning,1015.2004264439491,1020.1191335144053,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
12 |
+
SD3,SD3,1007.471271377597,1008.854522133864,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
AuraFlow,AuraFlow,994.7099309378694,992.0073720460473,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
14 |
+
SDXL,SDXL,964.3393840425979,966.2143902640547,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,913.5301722124198,912.3036972441694,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),903.9322049158155,898.80386711014,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,831.101193905027,827.1190236494888,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,789.2921897695156,804.6097389434616,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/20250302/video_generation_leaderboard.csv
ADDED
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
CogVideoX-5B,CogVideoX-5B,1132.925159664805,1135.0982584525286,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
3 |
+
Mochi1,Mochi1,1125.1106706454923,1124.737696633387,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
4 |
+
StableVideoDiffusion,StableVideoDiffusion,1119.6076955655947,1119.613458193588,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
5 |
+
Pyramid Flow,Pyramid Flow,1108.9461101457714,1110.8121652424368,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
6 |
+
T2V-Turbo,T2V-Turbo,1055.8620215128847,1056.266884841949,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
7 |
+
CogVideoX-2B,CogVideoX-2B,1049.0348969420825,1047.4345676555026,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
8 |
+
AnimateDiff,AnimateDiff,1040.7891462587384,1040.2520828123386,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
9 |
+
VideoCrafter2,VideoCrafter2,1032.7516393058327,1032.1470606868284,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
10 |
+
Allegro,Allegro,988.4057808780616,991.1063406036561,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
11 |
+
LaVie,LaVie,966.3120235763104,965.7780389173241,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
12 |
+
LTXVideo,LTXVideo,955.2840792644713,956.39077016098,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
13 |
+
OpenSora,OpenSora,882.721843956462,881.911726464153,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
14 |
+
OpenSora v1.2,OpenSora v1.2,873.5572911234422,870.9027729304647,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,836.0954492040325,834.2730948209512,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
16 |
+
ModelScope,ModelScope,832.5961919560206,833.2750815839162,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
@@ -119260,5 +119260,19 @@
|
|
119260 |
"judge": "arena_user_10.16.36.250",
|
119261 |
"anony": false,
|
119262 |
"tstamp": 1740844997.8916
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
119263 |
}
|
119264 |
]
|
|
|
119260 |
"judge": "arena_user_10.16.36.250",
|
119261 |
"anony": false,
|
119262 |
"tstamp": 1740844997.8916
|
119263 |
+
},
|
119264 |
+
{
|
119265 |
+
"model_a_conv_id": "24b946f24f19433387aacf4c0d740e8a",
|
119266 |
+
"model_b_conv_id": "55d6ac03435245efadee4913eb7538e3",
|
119267 |
+
"inputs": {
|
119268 |
+
"prompt": "A beige pastry sitting in a white ball next to a spoon ."
|
119269 |
+
},
|
119270 |
+
"model_a": "StableCascade",
|
119271 |
+
"model_b": "SDXLTurbo",
|
119272 |
+
"vote_type": "rightvote",
|
119273 |
+
"winner": "model_b",
|
119274 |
+
"judge": "arena_user_10.16.29.175",
|
119275 |
+
"anony": true,
|
119276 |
+
"tstamp": 1740916872.4033
|
119277 |
}
|
119278 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
@@ -40458,5 +40458,47 @@
|
|
40458 |
"judge": "arena_user_10.16.9.135",
|
40459 |
"anony": true,
|
40460 |
"tstamp": 1740825886.5715
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
40461 |
}
|
40462 |
]
|
|
|
40458 |
"judge": "arena_user_10.16.9.135",
|
40459 |
"anony": true,
|
40460 |
"tstamp": 1740825886.5715
|
40461 |
+
},
|
40462 |
+
{
|
40463 |
+
"model_a_conv_id": "20775e59a9854504b87a79449efe108c",
|
40464 |
+
"model_b_conv_id": "807657ce659d4367a1d55c94e08897de",
|
40465 |
+
"inputs": {
|
40466 |
+
"prompt": "a bicycle"
|
40467 |
+
},
|
40468 |
+
"model_a": "AnimateDiff",
|
40469 |
+
"model_b": "AnimateDiff Turbo",
|
40470 |
+
"vote_type": "bothbad_vote",
|
40471 |
+
"winner": "tie (bothbad)",
|
40472 |
+
"judge": "arena_user_10.20.28.164",
|
40473 |
+
"anony": false,
|
40474 |
+
"tstamp": 1740922279.4598
|
40475 |
+
},
|
40476 |
+
{
|
40477 |
+
"model_a_conv_id": "e970c401f9a14a99acea80c79e61e5e1",
|
40478 |
+
"model_b_conv_id": "5e4acc2b5f6c4ceb9d718ba9e640ed83",
|
40479 |
+
"inputs": {
|
40480 |
+
"prompt": "a person and a hair drier"
|
40481 |
+
},
|
40482 |
+
"model_a": "AnimateDiff",
|
40483 |
+
"model_b": "AnimateDiff Turbo",
|
40484 |
+
"vote_type": "leftvote",
|
40485 |
+
"winner": "model_a",
|
40486 |
+
"judge": "arena_user_10.20.6.93",
|
40487 |
+
"anony": false,
|
40488 |
+
"tstamp": 1740922296.129
|
40489 |
+
},
|
40490 |
+
{
|
40491 |
+
"model_a_conv_id": "7c6c0769badc44a68ac83237e5a81108",
|
40492 |
+
"model_b_conv_id": "90cd9807f319483bb247d8baa211c40a",
|
40493 |
+
"inputs": {
|
40494 |
+
"prompt": "Yoda playing guitar on the stage"
|
40495 |
+
},
|
40496 |
+
"model_a": "AnimateDiff",
|
40497 |
+
"model_b": "AnimateDiff Turbo",
|
40498 |
+
"vote_type": "leftvote",
|
40499 |
+
"winner": "model_a",
|
40500 |
+
"judge": "arena_user_10.20.6.93",
|
40501 |
+
"anony": false,
|
40502 |
+
"tstamp": 1740922316.8195
|
40503 |
}
|
40504 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 88249
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:63dbf15aa26b8b2b369373df116d1d24d987f712081d20692da094f5f5b27d95
|
3 |
size 88249
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 81355
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0681d8e3f8ce34f2d20de90413387e905ecda5bd8b09387e6922c0ca3d73f4a6
|
3 |
size 81355
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
@@ -1,18 +1,18 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
FLUX.1-dev,FLUX.1-dev,1142.
|
3 |
-
PlayGround V2.5,PlayGround V2.5,1114.
|
4 |
-
FLUX.1-schnell,FLUX.1-schnell,1095.
|
5 |
-
PlayGround V2,PlayGround V2,1070.
|
6 |
-
Kolors,Kolors,1060.
|
7 |
-
StableCascade,StableCascade,1042.
|
8 |
-
HunyuanDiT,HunyuanDiT,1020.
|
9 |
-
PixArtAlpha,PixArtAlpha,1018.
|
10 |
-
PixArtSigma,PixArtSigma,1016.
|
11 |
-
SDXL-Lightning,SDXL-Lightning,1015.
|
12 |
-
SD3,SD3,1007.
|
13 |
-
AuraFlow,AuraFlow,994.
|
14 |
-
SDXL,SDXL,964.
|
15 |
-
SDXLTurbo,SDXLTurbo,913.
|
16 |
-
LCM(v1.5/XL),LCM(v1.5/XL),903.
|
17 |
-
OpenJourney,OpenJourney,831.
|
18 |
-
LCM,LCM,789.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FLUX.1-dev,FLUX.1-dev,1142.112390379867,1138.3047211898725,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
3 |
+
PlayGround V2.5,PlayGround V2.5,1114.2417276451602,1117.248545391814,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
4 |
+
FLUX.1-schnell,FLUX.1-schnell,1095.2118164933304,1099.2642394085974,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
5 |
+
PlayGround V2,PlayGround V2,1070.9945288850886,1071.3626819356546,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
Kolors,Kolors,1060.0208684082033,1058.8848691929727,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
7 |
+
StableCascade,StableCascade,1042.150437254075,1045.044371277998,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
HunyuanDiT,HunyuanDiT,1020.0885444105875,1015.2227870100409,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
9 |
+
PixArtAlpha,PixArtAlpha,1018.631588065109,1011.6650123985901,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
10 |
+
PixArtSigma,PixArtSigma,1016.9713248537824,1017.8074215819955,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
11 |
+
SDXL-Lightning,SDXL-Lightning,1015.2004264439491,1020.1191335144053,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
12 |
+
SD3,SD3,1007.471271377597,1008.854522133864,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
AuraFlow,AuraFlow,994.7099309378694,992.0073720460473,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
14 |
+
SDXL,SDXL,964.3393840425979,966.2143902640547,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,913.5301722124198,912.3036972441694,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),903.9322049158155,898.80386711014,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,831.101193905027,827.1190236494888,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,789.2921897695156,804.6097389434616,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
@@ -1,16 +1,16 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
CogVideoX-5B,CogVideoX-5B,1132.925159664805,1135.
|
3 |
-
Mochi1,Mochi1,1125.1106706454923,1124.
|
4 |
-
StableVideoDiffusion,StableVideoDiffusion,1119.6076955655947,1119.
|
5 |
-
Pyramid Flow,Pyramid Flow,1108.9461101457714,1110.
|
6 |
-
T2V-Turbo,T2V-Turbo,1055.8620215128847,1056.
|
7 |
-
CogVideoX-2B,CogVideoX-2B,1049.0348969420825,1047.
|
8 |
-
AnimateDiff,AnimateDiff,1040.7891462587384,1040.
|
9 |
-
VideoCrafter2,VideoCrafter2,1032.7516393058327,1032.
|
10 |
-
Allegro,Allegro,988.4057808780616,991.
|
11 |
-
LaVie,LaVie,966.3120235763104,965.
|
12 |
-
LTXVideo,LTXVideo,955.2840792644713,956.
|
13 |
-
OpenSora,OpenSora,882.721843956462,881.
|
14 |
-
OpenSora v1.2,OpenSora v1.2,873.5572911234422,870.
|
15 |
-
AnimateDiff Turbo,AnimateDiff Turbo,836.0954492040325,834.
|
16 |
-
ModelScope,ModelScope,832.5961919560206,833.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
CogVideoX-5B,CogVideoX-5B,1132.925159664805,1135.0982584525286,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
3 |
+
Mochi1,Mochi1,1125.1106706454923,1124.737696633387,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
4 |
+
StableVideoDiffusion,StableVideoDiffusion,1119.6076955655947,1119.613458193588,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
5 |
+
Pyramid Flow,Pyramid Flow,1108.9461101457714,1110.8121652424368,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
6 |
+
T2V-Turbo,T2V-Turbo,1055.8620215128847,1056.266884841949,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
7 |
+
CogVideoX-2B,CogVideoX-2B,1049.0348969420825,1047.4345676555026,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
8 |
+
AnimateDiff,AnimateDiff,1040.7891462587384,1040.2520828123386,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
9 |
+
VideoCrafter2,VideoCrafter2,1032.7516393058327,1032.1470606868284,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
10 |
+
Allegro,Allegro,988.4057808780616,991.1063406036561,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
11 |
+
LaVie,LaVie,966.3120235763104,965.7780389173241,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
12 |
+
LTXVideo,LTXVideo,955.2840792644713,956.39077016098,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
13 |
+
OpenSora,OpenSora,882.721843956462,881.911726464153,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
14 |
+
OpenSora v1.2,OpenSora v1.2,873.5572911234422,870.9027729304647,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,836.0954492040325,834.2730948209512,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
16 |
+
ModelScope,ModelScope,832.5961919560206,833.2750815839162,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|