Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
2a80cb3
·
1 Parent(s): 90255bc

Auto Daily Leaderboard udpate Mon Feb 17 12:00:32 PM EST 2025

Browse files
Files changed (12) hide show
  1. arena_elo/results/20250217/clean_battle_image_editing.json +0 -0
  2. arena_elo/results/20250217/clean_battle_t2i_generation.json +0 -0
  3. arena_elo/results/20250217/elo_results_image_editing.pkl +3 -0
  4. arena_elo/results/20250217/elo_results_t2i_generation.pkl +3 -0
  5. arena_elo/results/20250217/image_editing_leaderboard.csv +11 -0
  6. arena_elo/results/20250217/t2i_generation_leaderboard.csv +18 -0
  7. arena_elo/results/latest/clean_battle_image_editing.json +32 -0
  8. arena_elo/results/latest/clean_battle_t2i_generation.json +14 -0
  9. arena_elo/results/latest/elo_results_image_editing.pkl +2 -2
  10. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  11. arena_elo/results/latest/image_editing_leaderboard.csv +10 -10
  12. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
arena_elo/results/20250217/clean_battle_image_editing.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20250217/clean_battle_t2i_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20250217/elo_results_image_editing.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2562b870c8375cf1cac3bd56dabe85c2e6f0a7b90451847aa5ac1ef16909d9c
3
+ size 66025
arena_elo/results/20250217/elo_results_t2i_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd0e44ef14aa18c6145b4beb1a75c133efc5716cf2968a009e7f7803bf942813
3
+ size 88249
arena_elo/results/20250217/image_editing_leaderboard.csv ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ MagicBrush,MagicBrush,1098.1235749576215,1102.119706123162,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
+ UltraEdit,UltraEdit,1067.7677518311405,1067.6239831253197,other,Peking University; BIGAI,https://ultra-editing.github.io/
4
+ InfEdit,InfEdit,1064.1137736939024,1063.9132078748696,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
5
+ CosXLEdit,CosXLEdit,1055.6346253269558,1056.6223091819759,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
6
+ InstructPix2Pix,InstructPix2Pix,1030.788425358858,1028.6187681214512,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
7
+ PNP,PNP,991.27816691656,995.7516580343394,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
8
+ Prompt2prompt,Prompt2prompt,983.8508707800156,984.9516876592888,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
9
+ CycleDiffusion,CycleDiffusion,934.7850922720994,928.661221084011,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
10
+ SDEdit,SDEdit,918.793223253551,917.2984189750662,MIT License,Stanford University,https://sde-image-editing.github.io
11
+ Pix2PixZero,Pix2PixZero,854.8644956092962,854.4390398205157,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
arena_elo/results/20250217/t2i_generation_leaderboard.csv ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1134.642010058254,1135.2742115755425,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1115.7457943952948,1117.773955661986,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1096.979110428484,1100.5677240028567,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1070.723999670234,1070.8260497536505,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1057.9805855243344,1056.9272692877275,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1041.6771325377642,1044.4579433606862,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1022.2367271423345,1017.0961134596428,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ PixArtAlpha,PixArtAlpha,1018.0114471615258,1010.8501268688682,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
+ PixArtSigma,PixArtSigma,1016.6709105350532,1017.0509068023207,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ SDXL-Lightning,SDXL-Lightning,1016.0546188285583,1020.8432125637014,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
12
+ SD3,SD3,1013.1395947318947,1013.6677475424369,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,996.7833989942876,993.8549602134261,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,963.8422477992643,965.7853511583572,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.0448591831017,911.5472515597098,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),903.6550377374083,898.3121990864532,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,830.097499675762,825.9964670252457,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,788.715025596437,803.8711574228385,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/clean_battle_image_editing.json CHANGED
@@ -20248,5 +20248,37 @@
20248
  "judge": "arena_user_10.16.9.135",
20249
  "anony": true,
20250
  "tstamp": 1739218410.8352
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20251
  }
20252
  ]
 
20248
  "judge": "arena_user_10.16.9.135",
20249
  "anony": true,
20250
  "tstamp": 1739218410.8352
20251
+ },
20252
+ {
20253
+ "model_a_conv_id": "2e22b3ba97e7448291a37b57bf946a30",
20254
+ "model_b_conv_id": "003db077240d4939b05342b64246570e",
20255
+ "inputs": {
20256
+ "source_prompt": "A picture of a badly decorated wedding cake.",
20257
+ "target_prompt": "A picture of a beautifully decorated wedding cake with fruits instead of donuts.",
20258
+ "instruct_prompt": "replace the donuts with fruits"
20259
+ },
20260
+ "model_a": "InfEdit",
20261
+ "model_b": "Prompt2prompt",
20262
+ "vote_type": "tievote",
20263
+ "winner": "tie",
20264
+ "judge": "arena_user_10.20.34.20",
20265
+ "anony": true,
20266
+ "tstamp": 1739810631.6093
20267
+ },
20268
+ {
20269
+ "model_a_conv_id": "2be8823288974ac59afb3cce7094f23f",
20270
+ "model_b_conv_id": "dddaa204029a4c9298e19553030d1f2f",
20271
+ "inputs": {
20272
+ "source_prompt": "A close-up of a cupcake and a cup of coffee on a table.",
20273
+ "target_prompt": "A close-up of a cupcake and a beer on a table.",
20274
+ "instruct_prompt": "Replace the coffee with beer."
20275
+ },
20276
+ "model_a": "SDEdit",
20277
+ "model_b": "UltraEdit",
20278
+ "vote_type": "rightvote",
20279
+ "winner": "model_b",
20280
+ "judge": "arena_user_10.20.34.20",
20281
+ "anony": true,
20282
+ "tstamp": 1739810648.8631
20283
  }
20284
  ]
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -118056,5 +118056,19 @@
118056
  "judge": "arena_user_10.16.39.39",
118057
  "anony": true,
118058
  "tstamp": 1739691009.9344
 
 
 
 
 
 
 
 
 
 
 
 
 
 
118059
  }
118060
  ]
 
118056
  "judge": "arena_user_10.16.39.39",
118057
  "anony": true,
118058
  "tstamp": 1739691009.9344
118059
+ },
118060
+ {
118061
+ "model_a_conv_id": "6712f40fd5a4487aafa67799f96e08bb",
118062
+ "model_b_conv_id": "96e3608ac18041a9b171516e1105929c",
118063
+ "inputs": {
118064
+ "prompt": "A white colored sandwich."
118065
+ },
118066
+ "model_a": "FLUX.1-schnell",
118067
+ "model_b": "SDXL-Lightning",
118068
+ "vote_type": "tievote",
118069
+ "winner": "tie",
118070
+ "judge": "arena_user_10.20.34.20",
118071
+ "anony": true,
118072
+ "tstamp": 1739809443.5325
118073
  }
118074
  ]
arena_elo/results/latest/elo_results_image_editing.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:89609f0565bd61b04f5f8af376e90b4aec4e52555fe40a5a6a782bad74c0b2d6
3
- size 66016
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2562b870c8375cf1cac3bd56dabe85c2e6f0a7b90451847aa5ac1ef16909d9c
3
+ size 66025
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e84d24aaf9e4715b971c9f856eeb305c49a84eb36db48cb9f2fa63863495332d
3
  size 88249
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd0e44ef14aa18c6145b4beb1a75c133efc5716cf2968a009e7f7803bf942813
3
  size 88249
arena_elo/results/latest/image_editing_leaderboard.csv CHANGED
@@ -1,11 +1,11 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- MagicBrush,MagicBrush,1098.7452090361044,1102.748734759451,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
- InfEdit,InfEdit,1065.1144160457052,1064.8946454646214,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
4
- UltraEdit,UltraEdit,1061.2239053702776,1061.1035139365567,other,Peking University; BIGAI,https://ultra-editing.github.io/
5
- CosXLEdit,CosXLEdit,1056.263566785872,1057.2477671026693,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
6
- InstructPix2Pix,InstructPix2Pix,1031.4300404573187,1029.2569442729496,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
7
- PNP,PNP,991.9498105145556,996.419559257891,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
8
- Prompt2prompt,Prompt2prompt,984.2911818424319,985.3972273129044,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
9
- CycleDiffusion,CycleDiffusion,935.4040467896915,929.286952722603,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
10
- SDEdit,SDEdit,920.1854063804685,918.6743721111048,MIT License,Stanford University,https://sde-image-editing.github.io
11
- Pix2PixZero,Pix2PixZero,855.3924167775742,854.970283059249,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ MagicBrush,MagicBrush,1098.1235749576215,1102.119706123162,CC-BY-4.0,"The Ohio State University, University of Waterloo",https://osu-nlp-group.github.io/MagicBrush/
3
+ UltraEdit,UltraEdit,1067.7677518311405,1067.6239831253197,other,Peking University; BIGAI,https://ultra-editing.github.io/
4
+ InfEdit,InfEdit,1064.1137736939024,1063.9132078748696,CC BY-NC-ND 4.0,"University of Michigan, University of California, Berkeley",https://sled-group.github.io/InfEdit/
5
+ CosXLEdit,CosXLEdit,1055.6346253269558,1056.6223091819759,cosxl-nc-community,Stability AI,https://huggingface.co/stabilityai/cosxl
6
+ InstructPix2Pix,InstructPix2Pix,1030.788425358858,1028.6187681214512,"Copyright 2023 Timothy Brooks, Aleksander Holynski, Alexei A. Efros","University of California, Berkeley",https://www.timothybrooks.com/instruct-pix2pix
7
+ PNP,PNP,991.27816691656,995.7516580343394,-,Weizmann Institute of Science,https://github.com/MichalGeyer/plug-and-play
8
+ Prompt2prompt,Prompt2prompt,983.8508707800156,984.9516876592888,Apache-2.0,"Google, Tel Aviv University",https://prompt-to-prompt.github.io/
9
+ CycleDiffusion,CycleDiffusion,934.7850922720994,928.661221084011,X11,Carnegie Mellon University,https://github.com/ChenWu98/cycle-diffusion?tab=readme-ov-file
10
+ SDEdit,SDEdit,918.793223253551,917.2984189750662,MIT License,Stanford University,https://sde-image-editing.github.io
11
+ Pix2PixZero,Pix2PixZero,854.8644956092962,854.4390398205157,MIT License,"Carnegie Mellon University, Adobe Research",https://pix2pixzero.github.io/
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- FLUX.1-dev,FLUX.1-dev,1134.666298457848,1135.3067266143985,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
- PlayGround V2.5,PlayGround V2.5,1115.7330407521506,1117.7638127440623,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
- FLUX.1-schnell,FLUX.1-schnell,1097.2333310458744,1100.7589286144919,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1070.6994815716591,1070.8051232401253,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1057.9869382055147,1056.9334062096789,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- StableCascade,StableCascade,1041.658104234974,1044.4395228304218,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
- HunyuanDiT,HunyuanDiT,1022.2276129229191,1017.0869178015068,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
- PixArtAlpha,PixArtAlpha,1017.9919464185682,1010.8325211702457,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
- PixArtSigma,PixArtSigma,1016.653958442178,1017.0358321377211,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
- SDXL-Lightning,SDXL-Lightning,1015.9613313704906,1020.764707286756,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
12
- SD3,SD3,1013.1363556058876,1013.6593792436016,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
- AuraFlow,AuraFlow,996.8042535061384,993.8747818586052,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
- SDXL,SDXL,963.8236697854666,965.7678891792774,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,913.0254779323765,911.5296438569977,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),903.6290681260801,898.2901817676839,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,830.0766079765388,825.9776852694157,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,788.6925236453433,803.8513698586544,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1134.642010058254,1135.2742115755425,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1115.7457943952948,1117.773955661986,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1096.979110428484,1100.5677240028567,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1070.723999670234,1070.8260497536505,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1057.9805855243344,1056.9272692877275,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1041.6771325377642,1044.4579433606862,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1022.2367271423345,1017.0961134596428,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ PixArtAlpha,PixArtAlpha,1018.0114471615258,1010.8501268688682,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
+ PixArtSigma,PixArtSigma,1016.6709105350532,1017.0509068023207,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
11
+ SDXL-Lightning,SDXL-Lightning,1016.0546188285583,1020.8432125637014,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
12
+ SD3,SD3,1013.1395947318947,1013.6677475424369,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,996.7833989942876,993.8549602134261,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,963.8422477992643,965.7853511583572,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.0448591831017,911.5472515597098,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),903.6550377374083,898.3121990864532,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,830.097499675762,825.9964670252457,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,788.715025596437,803.8711574228385,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7