Spaces:
Running
on
Zero
Running
on
Zero
Commit
·
fd3460f
1
Parent(s):
edd3046
Auto Daily Leaderboard udpate Tue Jan 14 12:00:28 PM EST 2025
Browse files- arena_elo/results/20250114/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20250114/clean_battle_video_generation.json +0 -0
- arena_elo/results/20250114/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20250114/elo_results_video_generation.pkl +3 -0
- arena_elo/results/20250114/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/20250114/video_generation_leaderboard.csv +16 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +14 -0
- arena_elo/results/latest/clean_battle_video_generation.json +28 -0
- arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
- arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
- arena_elo/results/latest/video_generation_leaderboard.csv +15 -15
arena_elo/results/20250114/clean_battle_t2i_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20250114/clean_battle_video_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20250114/elo_results_t2i_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3b238f475b4eb43a09ddb03d381908adec892111e11bbd942e52136ff66e40c5
|
3 |
+
size 88249
|
arena_elo/results/20250114/elo_results_video_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a7424dc9cbe9f0edd1b9ccc575470a40595e651e8004e7c5297f1bc1925bd662
|
3 |
+
size 81356
|
arena_elo/results/20250114/t2i_generation_leaderboard.csv
ADDED
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FLUX.1-dev,FLUX.1-dev,1130.1041606589642,1134.3586178176306,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
3 |
+
PlayGround V2.5,PlayGround V2.5,1114.965435288425,1116.0440589540867,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
4 |
+
FLUX.1-schnell,FLUX.1-schnell,1096.1849113793912,1101.589158822972,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
5 |
+
PlayGround V2,PlayGround V2,1071.4521482453924,1071.3321355156513,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
Kolors,Kolors,1055.084930517111,1054.1155485177167,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
7 |
+
StableCascade,StableCascade,1041.4923033998684,1044.2013892283053,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
HunyuanDiT,HunyuanDiT,1025.2411996181988,1019.3788327491618,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
9 |
+
PixArtAlpha,PixArtAlpha,1019.5252084372482,1011.9721053947055,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
10 |
+
SDXL-Lightning,SDXL-Lightning,1019.0207072906311,1023.3005660997613,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
11 |
+
PixArtSigma,PixArtSigma,1015.6950012099896,1015.8764983531428,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
12 |
+
SD3,SD3,1011.7714284840165,1011.171788793322,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
AuraFlow,AuraFlow,996.166790243772,992.9495120874249,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
14 |
+
SDXL,SDXL,965.2925667148811,967.1418582004937,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,912.9740202663493,911.4664693604659,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.3163975604635,898.7650945963446,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,831.0953180355204,826.7608943830825,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,789.6174726497807,804.5660718314193,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/20250114/video_generation_leaderboard.csv
ADDED
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
CogVideoX-5B,CogVideoX-5B,1150.1263105317723,1146.2845690893255,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
3 |
+
Mochi1,Mochi1,1133.3221650141832,1133.1515728590348,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
4 |
+
Pyramid Flow,Pyramid Flow,1130.1029338395977,1132.4800004481656,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
5 |
+
StableVideoDiffusion,StableVideoDiffusion,1115.2071129742742,1117.3721734675119,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
6 |
+
T2V-Turbo,T2V-Turbo,1054.6212365614213,1054.3715355179597,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
7 |
+
CogVideoX-2B,CogVideoX-2B,1048.0451584955367,1045.1992823917626,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
8 |
+
AnimateDiff,AnimateDiff,1035.7907570328914,1036.0618682697682,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
9 |
+
VideoCrafter2,VideoCrafter2,1028.6805200768615,1029.125412510577,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
10 |
+
Allegro,Allegro,998.1797731521868,1001.3099093198848,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
11 |
+
LaVie,LaVie,962.1217676145346,962.2752936385602,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
12 |
+
LTXVideo,LTXVideo,959.1048096691326,960.7815221248546,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
13 |
+
OpenSora,OpenSora,878.506379889196,878.2677622168235,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
14 |
+
OpenSora v1.2,OpenSora v1.2,845.6707862663665,843.289951613884,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,832.0832781740031,830.3575192684434,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
16 |
+
ModelScope,ModelScope,828.4370107080416,829.6716272634425,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
@@ -115116,5 +115116,19 @@
|
|
115116 |
"judge": "arena_user_10.20.26.107",
|
115117 |
"anony": true,
|
115118 |
"tstamp": 1736778554.0162
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
115119 |
}
|
115120 |
]
|
|
|
115116 |
"judge": "arena_user_10.20.26.107",
|
115117 |
"anony": true,
|
115118 |
"tstamp": 1736778554.0162
|
115119 |
+
},
|
115120 |
+
{
|
115121 |
+
"model_a_conv_id": "1120cdb42be84526afbaa7ba3126cbc0",
|
115122 |
+
"model_b_conv_id": "958203a68cac48518305b5d24d7fd882",
|
115123 |
+
"inputs": {
|
115124 |
+
"prompt": "A fluffy orange tabby cat sits upright, singing melodiously with its mouth open as if performing a song. The cat’s fur is soft and well-groomed, with striking green eyes that glisten in the warm natural light. It wears a tiny, red bowtie around its neck, adding a charming touch. The background is a cozy living room with a plush couch and a few potted plants, softly blurred to keep the focus on the cat. The camera angle is a close-up, centered on the cat’s face and upper body, capturing its expressive posture. The lighting is warm and inviting, suggesting an early evening setting. The scene feels lively and real, with a whimsical yet natural tone."
|
115125 |
+
},
|
115126 |
+
"model_a": "PlayGround V2.5",
|
115127 |
+
"model_b": "FLUX.1-schnell",
|
115128 |
+
"vote_type": "tievote",
|
115129 |
+
"winner": "tie",
|
115130 |
+
"judge": "arena_user_10.16.39.228",
|
115131 |
+
"anony": true,
|
115132 |
+
"tstamp": 1736870062.014
|
115133 |
}
|
115134 |
]
|
arena_elo/results/latest/clean_battle_video_generation.json
CHANGED
@@ -37126,5 +37126,33 @@
|
|
37126 |
"judge": "arena_user_10.16.5.242",
|
37127 |
"anony": true,
|
37128 |
"tstamp": 1736643493.6786
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
37129 |
}
|
37130 |
]
|
|
|
37126 |
"judge": "arena_user_10.16.5.242",
|
37127 |
"anony": true,
|
37128 |
"tstamp": 1736643493.6786
|
37129 |
+
},
|
37130 |
+
{
|
37131 |
+
"model_a_conv_id": "d5fc7abf1f774b978ab70a059cf7f22e",
|
37132 |
+
"model_b_conv_id": "41e45db2ca24467e84649c7b5d086f9d",
|
37133 |
+
"inputs": {
|
37134 |
+
"prompt": "A person is barbequing"
|
37135 |
+
},
|
37136 |
+
"model_a": "AnimateDiff Turbo",
|
37137 |
+
"model_b": "Mochi1",
|
37138 |
+
"vote_type": "rightvote",
|
37139 |
+
"winner": "model_b",
|
37140 |
+
"judge": "arena_user_10.16.37.94",
|
37141 |
+
"anony": true,
|
37142 |
+
"tstamp": 1736870115.3482
|
37143 |
+
},
|
37144 |
+
{
|
37145 |
+
"model_a_conv_id": "e9c5ebc72b5149739587365fb6b8861b",
|
37146 |
+
"model_b_conv_id": "d0db4e254b71493fbdb35455809b2d9b",
|
37147 |
+
"inputs": {
|
37148 |
+
"prompt": "highway"
|
37149 |
+
},
|
37150 |
+
"model_a": "Mochi1",
|
37151 |
+
"model_b": "CogVideoX-2B",
|
37152 |
+
"vote_type": "bothbad_vote",
|
37153 |
+
"winner": "tie (bothbad)",
|
37154 |
+
"judge": "arena_user_10.16.39.228",
|
37155 |
+
"anony": true,
|
37156 |
+
"tstamp": 1736870124.2769
|
37157 |
}
|
37158 |
]
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 88249
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3b238f475b4eb43a09ddb03d381908adec892111e11bbd942e52136ff66e40c5
|
3 |
size 88249
|
arena_elo/results/latest/elo_results_video_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 81356
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a7424dc9cbe9f0edd1b9ccc575470a40595e651e8004e7c5297f1bc1925bd662
|
3 |
size 81356
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
@@ -1,18 +1,18 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
FLUX.1-dev,FLUX.1-dev,1130.
|
3 |
-
PlayGround V2.5,PlayGround V2.5,1114.
|
4 |
-
FLUX.1-schnell,FLUX.1-schnell,1096.
|
5 |
-
PlayGround V2,PlayGround V2,1071.
|
6 |
-
Kolors,Kolors,1055.
|
7 |
-
StableCascade,StableCascade,1041.
|
8 |
-
HunyuanDiT,HunyuanDiT,1025.
|
9 |
-
PixArtAlpha,PixArtAlpha,1019.
|
10 |
-
SDXL-Lightning,SDXL-Lightning,1019.
|
11 |
-
PixArtSigma,PixArtSigma,1015.
|
12 |
-
SD3,SD3,1011.
|
13 |
-
AuraFlow,AuraFlow,996.
|
14 |
-
SDXL,SDXL,965.
|
15 |
-
SDXLTurbo,SDXLTurbo,912.
|
16 |
-
LCM(v1.5/XL),LCM(v1.5/XL),904.
|
17 |
-
OpenJourney,OpenJourney,831.
|
18 |
-
LCM,LCM,789.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FLUX.1-dev,FLUX.1-dev,1130.1041606589642,1134.3586178176306,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
3 |
+
PlayGround V2.5,PlayGround V2.5,1114.965435288425,1116.0440589540867,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
4 |
+
FLUX.1-schnell,FLUX.1-schnell,1096.1849113793912,1101.589158822972,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
5 |
+
PlayGround V2,PlayGround V2,1071.4521482453924,1071.3321355156513,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
Kolors,Kolors,1055.084930517111,1054.1155485177167,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
7 |
+
StableCascade,StableCascade,1041.4923033998684,1044.2013892283053,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
HunyuanDiT,HunyuanDiT,1025.2411996181988,1019.3788327491618,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
9 |
+
PixArtAlpha,PixArtAlpha,1019.5252084372482,1011.9721053947055,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
10 |
+
SDXL-Lightning,SDXL-Lightning,1019.0207072906311,1023.3005660997613,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
11 |
+
PixArtSigma,PixArtSigma,1015.6950012099896,1015.8764983531428,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
12 |
+
SD3,SD3,1011.7714284840165,1011.171788793322,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
AuraFlow,AuraFlow,996.166790243772,992.9495120874249,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
14 |
+
SDXL,SDXL,965.2925667148811,967.1418582004937,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,912.9740202663493,911.4664693604659,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.3163975604635,898.7650945963446,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,831.0953180355204,826.7608943830825,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,789.6174726497807,804.5660718314193,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/video_generation_leaderboard.csv
CHANGED
@@ -1,16 +1,16 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
CogVideoX-5B,CogVideoX-5B,1150.
|
3 |
-
Mochi1,Mochi1,1133.
|
4 |
-
Pyramid Flow,Pyramid Flow,1130.
|
5 |
-
StableVideoDiffusion,StableVideoDiffusion,1115.
|
6 |
-
T2V-Turbo,T2V-Turbo,1054.
|
7 |
-
CogVideoX-2B,CogVideoX-2B,
|
8 |
-
AnimateDiff,AnimateDiff,1035.
|
9 |
-
VideoCrafter2,VideoCrafter2,1028.
|
10 |
-
Allegro,Allegro,998.
|
11 |
-
LaVie,LaVie,962.
|
12 |
-
LTXVideo,LTXVideo,959.
|
13 |
-
OpenSora,OpenSora,878.
|
14 |
-
OpenSora v1.2,OpenSora v1.2,845.
|
15 |
-
AnimateDiff Turbo,AnimateDiff Turbo,832.
|
16 |
-
ModelScope,ModelScope,828.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
CogVideoX-5B,CogVideoX-5B,1150.1263105317723,1146.2845690893255,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
3 |
+
Mochi1,Mochi1,1133.3221650141832,1133.1515728590348,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
|
4 |
+
Pyramid Flow,Pyramid Flow,1130.1029338395977,1132.4800004481656,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
|
5 |
+
StableVideoDiffusion,StableVideoDiffusion,1115.2071129742742,1117.3721734675119,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
|
6 |
+
T2V-Turbo,T2V-Turbo,1054.6212365614213,1054.3715355179597,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
|
7 |
+
CogVideoX-2B,CogVideoX-2B,1048.0451584955367,1045.1992823917626,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
|
8 |
+
AnimateDiff,AnimateDiff,1035.7907570328914,1036.0618682697682,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
|
9 |
+
VideoCrafter2,VideoCrafter2,1028.6805200768615,1029.125412510577,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
|
10 |
+
Allegro,Allegro,998.1797731521868,1001.3099093198848,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
|
11 |
+
LaVie,LaVie,962.1217676145346,962.2752936385602,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
|
12 |
+
LTXVideo,LTXVideo,959.1048096691326,960.7815221248546,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
|
13 |
+
OpenSora,OpenSora,878.506379889196,878.2677622168235,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
14 |
+
OpenSora v1.2,OpenSora v1.2,845.6707862663665,843.289951613884,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
|
15 |
+
AnimateDiff Turbo,AnimateDiff Turbo,832.0832781740031,830.3575192684434,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
|
16 |
+
ModelScope,ModelScope,828.4370107080416,829.6716272634425,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
|