Spaces:
Running
on
Zero
Running
on
Zero
Commit
·
eb99390
1
Parent(s):
5d16b8f
Auto Daily Leaderboard udpate Mon Jan 27 12:00:32 PM EST 2025
Browse files- arena_elo/results/20250126/clean_battle_image_editing.json +0 -0
- arena_elo/results/20250126/elo_results_image_editing.pkl +3 -0
- arena_elo/results/20250126/image_editing_leaderboard.csv +11 -0
- arena_elo/results/20250127/clean_battle_t2i_generation.json +0 -0
- arena_elo/results/20250127/elo_results_t2i_generation.pkl +3 -0
- arena_elo/results/20250127/t2i_generation_leaderboard.csv +18 -0
- arena_elo/results/latest/clean_battle_image_editing.json +64 -0
- arena_elo/results/latest/clean_battle_t2i_generation.json +126 -0
- arena_elo/results/latest/elo_results_image_editing.pkl +2 -2
- arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
- arena_elo/results/latest/image_editing_leaderboard.csv +10 -10
- arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
arena_elo/results/20250126/clean_battle_image_editing.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20250126/elo_results_image_editing.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c290e086972a9e1e55d5cff8219f39f9d23742d6e26d7415f7546c411936a1d6
|
3 |
+
size 66016
|
arena_elo/results/20250126/image_editing_leaderboard.csv
ADDED
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
MagicBrush,MagicBrush,1097.3100007907678,1101.2646640130924,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
|
3 |
+
UltraEdit,UltraEdit,1076.7199437786915,1076.7884302702805,other,Peking University; BIGAI,https://ultra-editing.github.io/
|
4 |
+
InfEdit,InfEdit,1062.815033110414,1062.6026636381005,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
|
5 |
+
CosXLEdit,CosXLEdit,1056.5947844690245,1057.5018344986509,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
|
6 |
+
InstructPix2Pix,InstructPix2Pix,1030.435699372457,1028.2128077361917,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
|
7 |
+
PNP,PNP,990.3325816090269,994.7833768417363,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
|
8 |
+
Prompt2prompt,Prompt2prompt,982.5795240614932,983.6699944939771,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
|
9 |
+
CycleDiffusion,CycleDiffusion,932.0949704375688,926.0519442182516,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
|
10 |
+
SDEdit,SDEdit,917.7253904750747,916.1720307867208,MIT License,Stanford University,https://sde-image-editing.github.io
|
11 |
+
Pix2PixZero,Pix2PixZero,853.3920718954819,852.9522535029976,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
|
arena_elo/results/20250127/clean_battle_t2i_generation.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
arena_elo/results/20250127/elo_results_t2i_generation.pkl
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4fc06b45634b94b850353148b31c7e2c6b449f07aaebd0fdf9ad4bf7bcb5bdbb
|
3 |
+
size 88249
|
arena_elo/results/20250127/t2i_generation_leaderboard.csv
ADDED
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FLUX.1-dev,FLUX.1-dev,1133.44257891619,1135.49690509576,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
3 |
+
PlayGround V2.5,PlayGround V2.5,1115.0134639218338,1116.1821607624386,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
4 |
+
FLUX.1-schnell,FLUX.1-schnell,1091.771189507987,1098.2405044806856,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
5 |
+
PlayGround V2,PlayGround V2,1071.4985627793171,1071.3282923691663,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
Kolors,Kolors,1053.3259841267832,1052.3955916373568,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
7 |
+
StableCascade,StableCascade,1041.7251553567398,1044.3708283124172,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
HunyuanDiT,HunyuanDiT,1023.0475351976979,1017.5437186493975,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
9 |
+
PixArtAlpha,PixArtAlpha,1019.6816966455391,1012.1358519020689,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
10 |
+
SDXL-Lightning,SDXL-Lightning,1018.6252710664451,1022.9322058113568,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
11 |
+
PixArtSigma,PixArtSigma,1017.9126719376313,1018.1139378215531,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
12 |
+
SD3,SD3,1011.8725785035804,1012.7667675499658,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
AuraFlow,AuraFlow,999.4324207583649,996.1558321225002,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
14 |
+
SDXL,SDXL,964.3256909886288,966.2433168413681,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,913.1649632023751,911.5468002980388,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.4688549265815,898.8648139832336,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,831.1476089921828,826.7993430234785,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,789.5437731721254,804.4741412320506,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|
arena_elo/results/latest/clean_battle_image_editing.json
CHANGED
@@ -20120,5 +20120,69 @@
|
|
20120 |
"judge": "arena_user_10.16.17.134",
|
20121 |
"anony": true,
|
20122 |
"tstamp": 1737775135.4352
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
20123 |
}
|
20124 |
]
|
|
|
20120 |
"judge": "arena_user_10.16.17.134",
|
20121 |
"anony": true,
|
20122 |
"tstamp": 1737775135.4352
|
20123 |
+
},
|
20124 |
+
{
|
20125 |
+
"model_a_conv_id": "232faa24cd1542c79a70430875f32a0e",
|
20126 |
+
"model_b_conv_id": "be5ce7023179453995576b1a86d6bc98",
|
20127 |
+
"inputs": {
|
20128 |
+
"source_prompt": "A table with a jar of cookies, cake, and green apples on it.",
|
20129 |
+
"target_prompt": "A table with cake and green apples on it.",
|
20130 |
+
"instruct_prompt": "Get rid of the jar of cookies"
|
20131 |
+
},
|
20132 |
+
"model_a": "PNP",
|
20133 |
+
"model_b": "Prompt2prompt",
|
20134 |
+
"vote_type": "rightvote",
|
20135 |
+
"winner": "model_b",
|
20136 |
+
"judge": "arena_user_10.20.34.20",
|
20137 |
+
"anony": true,
|
20138 |
+
"tstamp": 1737920671.5585
|
20139 |
+
},
|
20140 |
+
{
|
20141 |
+
"model_a_conv_id": "14834aabced342299867cb93f37c18bb",
|
20142 |
+
"model_b_conv_id": "b7f21b51ad174915b612f5edb5d556d6",
|
20143 |
+
"inputs": {
|
20144 |
+
"source_prompt": "a tennis player with a racket on a court",
|
20145 |
+
"target_prompt": "A tennis player with a baseball cap and racket on a court",
|
20146 |
+
"instruct_prompt": "give her a baseball cap"
|
20147 |
+
},
|
20148 |
+
"model_a": "Pix2PixZero",
|
20149 |
+
"model_b": "CosXLEdit",
|
20150 |
+
"vote_type": "bothbad_vote",
|
20151 |
+
"winner": "tie (bothbad)",
|
20152 |
+
"judge": "arena_user_10.20.34.20",
|
20153 |
+
"anony": true,
|
20154 |
+
"tstamp": 1737920736.8002
|
20155 |
+
},
|
20156 |
+
{
|
20157 |
+
"model_a_conv_id": "2f1a07417d8c45a29d40bfc43c38114d",
|
20158 |
+
"model_b_conv_id": "120b265f3873454f98b58374d518c024",
|
20159 |
+
"inputs": {
|
20160 |
+
"source_prompt": "A kitchen with a large TV mounted to its wall.",
|
20161 |
+
"target_prompt": "A kitchen with a large TV mounted to its wall showing a show about cats.",
|
20162 |
+
"instruct_prompt": "Put a show about cats on the TV."
|
20163 |
+
},
|
20164 |
+
"model_a": "Pix2PixZero",
|
20165 |
+
"model_b": "UltraEdit",
|
20166 |
+
"vote_type": "rightvote",
|
20167 |
+
"winner": "model_b",
|
20168 |
+
"judge": "arena_user_10.20.34.20",
|
20169 |
+
"anony": true,
|
20170 |
+
"tstamp": 1737920765.7776
|
20171 |
+
},
|
20172 |
+
{
|
20173 |
+
"model_a_conv_id": "26dc8ca6677b4272af958bd7af009917",
|
20174 |
+
"model_b_conv_id": "20e62c7029464402ae1f32f4ad21f74d",
|
20175 |
+
"inputs": {
|
20176 |
+
"source_prompt": "Full grown cat laying down and sleeping on top of a car.",
|
20177 |
+
"target_prompt": "Full grown fox laying down and sleeping on top of a car.",
|
20178 |
+
"instruct_prompt": "change the cat to a fox."
|
20179 |
+
},
|
20180 |
+
"model_a": "SDEdit",
|
20181 |
+
"model_b": "Prompt2prompt",
|
20182 |
+
"vote_type": "leftvote",
|
20183 |
+
"winner": "model_a",
|
20184 |
+
"judge": "arena_user_10.20.26.107",
|
20185 |
+
"anony": true,
|
20186 |
+
"tstamp": 1737920831.2983
|
20187 |
}
|
20188 |
]
|
arena_elo/results/latest/clean_battle_t2i_generation.json
CHANGED
@@ -116124,5 +116124,131 @@
|
|
116124 |
"judge": "arena_user_10.20.34.20",
|
116125 |
"anony": true,
|
116126 |
"tstamp": 1737910068.5391
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
116127 |
}
|
116128 |
]
|
|
|
116124 |
"judge": "arena_user_10.20.34.20",
|
116125 |
"anony": true,
|
116126 |
"tstamp": 1737910068.5391
|
116127 |
+
},
|
116128 |
+
{
|
116129 |
+
"model_a_conv_id": "ee0ebc0026ee4e1cb698e341eb16fd08",
|
116130 |
+
"model_b_conv_id": "2e1591e065fe4f7799378763c601232f",
|
116131 |
+
"inputs": {
|
116132 |
+
"prompt": "Abraham Lincoln touches his toes while George Washington does chin-ups. Lincoln is barefoot. Washington is wearing boots."
|
116133 |
+
},
|
116134 |
+
"model_a": "FLUX.1-dev",
|
116135 |
+
"model_b": "OpenJourney",
|
116136 |
+
"vote_type": "leftvote",
|
116137 |
+
"winner": "model_a",
|
116138 |
+
"judge": "arena_user_10.20.26.107",
|
116139 |
+
"anony": true,
|
116140 |
+
"tstamp": 1737920313.1586
|
116141 |
+
},
|
116142 |
+
{
|
116143 |
+
"model_a_conv_id": "b01d55a0b30f4461aa521d6926935844",
|
116144 |
+
"model_b_conv_id": "daa3075e30604b898f83244fe2619203",
|
116145 |
+
"inputs": {
|
116146 |
+
"prompt": "futuristic city with forest, straight edged buildings, street signs, detailed shopfronts, video screens, impasto brush strokes, soft light, 8 k, dramatic composition, dramatic lighting, sharp focus, octane render, concept art, masterpiece, by adrian ghenie and jenny saville and zhang jingna "
|
116147 |
+
},
|
116148 |
+
"model_a": "OpenJourney",
|
116149 |
+
"model_b": "HunyuanDiT",
|
116150 |
+
"vote_type": "tievote",
|
116151 |
+
"winner": "tie",
|
116152 |
+
"judge": "arena_user_10.20.34.20",
|
116153 |
+
"anony": true,
|
116154 |
+
"tstamp": 1737920347.458
|
116155 |
+
},
|
116156 |
+
{
|
116157 |
+
"model_a_conv_id": "83ed24fabc664e6a98d1fcc8b601aa08",
|
116158 |
+
"model_b_conv_id": "ebe063637063487cb9495a450b78395b",
|
116159 |
+
"inputs": {
|
116160 |
+
"prompt": "A ldarge keybord msical instroument lwith a woden case enmclosig a qsouvnkboajrd and mfgtal strivgf, which are strucrk b hammrs when the nels are depresdsmed.f lhe strsingsj' vibration ie stopped by damperds when the keys re released and can bce regulavewdd for lengh and vnolume y two or three pedalvs."
|
116161 |
+
},
|
116162 |
+
"model_a": "SDXL-Lightning",
|
116163 |
+
"model_b": "StableCascade",
|
116164 |
+
"vote_type": "tievote",
|
116165 |
+
"winner": "tie",
|
116166 |
+
"judge": "arena_user_10.20.34.20",
|
116167 |
+
"anony": true,
|
116168 |
+
"tstamp": 1737920383.1483
|
116169 |
+
},
|
116170 |
+
{
|
116171 |
+
"model_a_conv_id": "3117e16b27d7463ca6167fe784aff4ec",
|
116172 |
+
"model_b_conv_id": "41e90d3f24a1417fa6f35a2b7e371ab6",
|
116173 |
+
"inputs": {
|
116174 |
+
"prompt": "A realistic photo of a Pomeranian dressed up like a 1980s professional wrestler with neon green and neon orange face paint and bright green wrestling tights with bright orange boots."
|
116175 |
+
},
|
116176 |
+
"model_a": "HunyuanDiT",
|
116177 |
+
"model_b": "SDXL-Lightning",
|
116178 |
+
"vote_type": "leftvote",
|
116179 |
+
"winner": "model_a",
|
116180 |
+
"judge": "arena_user_10.20.34.20",
|
116181 |
+
"anony": true,
|
116182 |
+
"tstamp": 1737920458.2726
|
116183 |
+
},
|
116184 |
+
{
|
116185 |
+
"model_a_conv_id": "304c6f764f7a4b188094e154e0f1f6a3",
|
116186 |
+
"model_b_conv_id": "a912e8fa708f4fa088aaf87219692a36",
|
116187 |
+
"inputs": {
|
116188 |
+
"prompt": "a god sitting on a pedestal of skeletons writing in his notebook"
|
116189 |
+
},
|
116190 |
+
"model_a": "AuraFlow",
|
116191 |
+
"model_b": "PlayGround V2.5",
|
116192 |
+
"vote_type": "leftvote",
|
116193 |
+
"winner": "model_a",
|
116194 |
+
"judge": "arena_user_10.16.39.228",
|
116195 |
+
"anony": true,
|
116196 |
+
"tstamp": 1737934315.2513
|
116197 |
+
},
|
116198 |
+
{
|
116199 |
+
"model_a_conv_id": "9be91c1d53224957b59a1579926bec34",
|
116200 |
+
"model_b_conv_id": "6b0003c116da478092ff10a35c084fef",
|
116201 |
+
"inputs": {
|
116202 |
+
"prompt": "there is a white street sign with a orange sign underneath"
|
116203 |
+
},
|
116204 |
+
"model_a": "OpenJourney",
|
116205 |
+
"model_b": "SDXLTurbo",
|
116206 |
+
"vote_type": "rightvote",
|
116207 |
+
"winner": "model_b",
|
116208 |
+
"judge": "arena_user_10.16.37.146",
|
116209 |
+
"anony": true,
|
116210 |
+
"tstamp": 1737959493.7339
|
116211 |
+
},
|
116212 |
+
{
|
116213 |
+
"model_a_conv_id": "6dad957e852b46ada2643eff03c24ba7",
|
116214 |
+
"model_b_conv_id": "eb280304f24d4c4ba8b088aa3cab07b2",
|
116215 |
+
"inputs": {
|
116216 |
+
"prompt": "A tennis racket underneath a traffic light."
|
116217 |
+
},
|
116218 |
+
"model_a": "StableCascade",
|
116219 |
+
"model_b": "PixArtSigma",
|
116220 |
+
"vote_type": "rightvote",
|
116221 |
+
"winner": "model_b",
|
116222 |
+
"judge": "arena_user_10.16.21.179",
|
116223 |
+
"anony": true,
|
116224 |
+
"tstamp": 1737959528.9286
|
116225 |
+
},
|
116226 |
+
{
|
116227 |
+
"model_a_conv_id": "3175894e2120482da60f134f8b12cda9",
|
116228 |
+
"model_b_conv_id": "0725b4132e1244c1b6fb268576c8e3e9",
|
116229 |
+
"inputs": {
|
116230 |
+
"prompt": "A lone man in a green jacket stands on a red snowboard in the snow ."
|
116231 |
+
},
|
116232 |
+
"model_a": "SDXL",
|
116233 |
+
"model_b": "FLUX.1-dev",
|
116234 |
+
"vote_type": "rightvote",
|
116235 |
+
"winner": "model_b",
|
116236 |
+
"judge": "arena_user_10.16.17.134",
|
116237 |
+
"anony": true,
|
116238 |
+
"tstamp": 1737985193.9172
|
116239 |
+
},
|
116240 |
+
{
|
116241 |
+
"model_a_conv_id": "4912802e30e74eae9184497abfbbac13",
|
116242 |
+
"model_b_conv_id": "0d7f792536e941bb9d90674c831a5c6a",
|
116243 |
+
"inputs": {
|
116244 |
+
"prompt": "A blue bunny in a pink water toilet bowl ."
|
116245 |
+
},
|
116246 |
+
"model_a": "StableCascade",
|
116247 |
+
"model_b": "PixArtAlpha",
|
116248 |
+
"vote_type": "leftvote",
|
116249 |
+
"winner": "model_a",
|
116250 |
+
"judge": "arena_user_10.16.6.226",
|
116251 |
+
"anony": true,
|
116252 |
+
"tstamp": 1737985221.0346
|
116253 |
}
|
116254 |
]
|
arena_elo/results/latest/elo_results_image_editing.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c290e086972a9e1e55d5cff8219f39f9d23742d6e26d7415f7546c411936a1d6
|
3 |
+
size 66016
|
arena_elo/results/latest/elo_results_t2i_generation.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 88249
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4fc06b45634b94b850353148b31c7e2c6b449f07aaebd0fdf9ad4bf7bcb5bdbb
|
3 |
size 88249
|
arena_elo/results/latest/image_editing_leaderboard.csv
CHANGED
@@ -1,11 +1,11 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
MagicBrush,MagicBrush,1097.
|
3 |
-
UltraEdit,UltraEdit,
|
4 |
-
InfEdit,InfEdit,
|
5 |
-
CosXLEdit,CosXLEdit,
|
6 |
-
InstructPix2Pix,InstructPix2Pix,1030.
|
7 |
-
PNP,PNP,
|
8 |
-
Prompt2prompt,Prompt2prompt,
|
9 |
-
CycleDiffusion,CycleDiffusion,932.
|
10 |
-
SDEdit,SDEdit,
|
11 |
-
Pix2PixZero,Pix2PixZero,853.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
MagicBrush,MagicBrush,1097.3100007907678,1101.2646640130924,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
|
3 |
+
UltraEdit,UltraEdit,1076.7199437786915,1076.7884302702805,other,Peking University; BIGAI,https://ultra-editing.github.io/
|
4 |
+
InfEdit,InfEdit,1062.815033110414,1062.6026636381005,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
|
5 |
+
CosXLEdit,CosXLEdit,1056.5947844690245,1057.5018344986509,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
|
6 |
+
InstructPix2Pix,InstructPix2Pix,1030.435699372457,1028.2128077361917,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
|
7 |
+
PNP,PNP,990.3325816090269,994.7833768417363,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
|
8 |
+
Prompt2prompt,Prompt2prompt,982.5795240614932,983.6699944939771,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
|
9 |
+
CycleDiffusion,CycleDiffusion,932.0949704375688,926.0519442182516,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
|
10 |
+
SDEdit,SDEdit,917.7253904750747,916.1720307867208,MIT License,Stanford University,https://sde-image-editing.github.io
|
11 |
+
Pix2PixZero,Pix2PixZero,853.3920718954819,852.9522535029976,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
|
arena_elo/results/latest/t2i_generation_leaderboard.csv
CHANGED
@@ -1,18 +1,18 @@
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
-
FLUX.1-dev,FLUX.1-dev,
|
3 |
-
PlayGround V2.5,PlayGround V2.5,1115.
|
4 |
-
FLUX.1-schnell,FLUX.1-schnell,1091.
|
5 |
-
PlayGround V2,PlayGround V2,1071.
|
6 |
-
Kolors,Kolors,1053.
|
7 |
-
StableCascade,StableCascade,
|
8 |
-
HunyuanDiT,HunyuanDiT,
|
9 |
-
PixArtAlpha,PixArtAlpha,
|
10 |
-
SDXL-Lightning,SDXL-Lightning,
|
11 |
-
PixArtSigma,PixArtSigma,1017.
|
12 |
-
SD3,SD3,1011.
|
13 |
-
AuraFlow,AuraFlow,
|
14 |
-
SDXL,SDXL,964.
|
15 |
-
SDXLTurbo,SDXLTurbo,913.
|
16 |
-
LCM(v1.5/XL),LCM(v1.5/XL),904.
|
17 |
-
OpenJourney,OpenJourney,831.
|
18 |
-
LCM,LCM,789.
|
|
|
1 |
key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
|
2 |
+
FLUX.1-dev,FLUX.1-dev,1133.44257891619,1135.49690509576,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
3 |
+
PlayGround V2.5,PlayGround V2.5,1115.0134639218338,1116.1821607624386,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
|
4 |
+
FLUX.1-schnell,FLUX.1-schnell,1091.771189507987,1098.2405044806856,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
|
5 |
+
PlayGround V2,PlayGround V2,1071.4985627793171,1071.3282923691663,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
|
6 |
+
Kolors,Kolors,1053.3259841267832,1052.3955916373568,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
|
7 |
+
StableCascade,StableCascade,1041.7251553567398,1044.3708283124172,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
|
8 |
+
HunyuanDiT,HunyuanDiT,1023.0475351976979,1017.5437186493975,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
|
9 |
+
PixArtAlpha,PixArtAlpha,1019.6816966455391,1012.1358519020689,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
|
10 |
+
SDXL-Lightning,SDXL-Lightning,1018.6252710664451,1022.9322058113568,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
|
11 |
+
PixArtSigma,PixArtSigma,1017.9126719376313,1018.1139378215531,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
|
12 |
+
SD3,SD3,1011.8725785035804,1012.7667675499658,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
|
13 |
+
AuraFlow,AuraFlow,999.4324207583649,996.1558321225002,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
|
14 |
+
SDXL,SDXL,964.3256909886288,966.2433168413681,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
|
15 |
+
SDXLTurbo,SDXLTurbo,913.1649632023751,911.5468002980388,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
|
16 |
+
LCM(v1.5/XL),LCM(v1.5/XL),904.4688549265815,898.8648139832336,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
|
17 |
+
OpenJourney,OpenJourney,831.1476089921828,826.7993430234785,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
|
18 |
+
LCM,LCM,789.5437731721254,804.4741412320506,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
|