Hugging Face's logo

Spaces:
TIGER-Lab
/
GenAI-Arena
Running on Zero

App Files Community
16
DongfuJiang commited on
Commit
59ce11f
·
1 Parent(s): 9653e02

Auto Daily Leaderboard udpate Thu Feb 6 12:00:29 PM EST 2025

Browse files
Files changed (12) hide show
  1. arena_elo/results/20250205/clean_battle_t2i_generation.json +14 -0
  2. arena_elo/results/20250205/elo_results_t2i_generation.pkl +1 -1
  3. arena_elo/results/20250205/t2i_generation_leaderboard.csv +17 -17
  4. arena_elo/results/20250206/clean_battle_video_generation.json +0 -0
  5. arena_elo/results/20250206/elo_results_video_generation.pkl +3 -0
  6. arena_elo/results/20250206/video_generation_leaderboard.csv +16 -0
  7. arena_elo/results/latest/clean_battle_t2i_generation.json +14 -0
  8. arena_elo/results/latest/clean_battle_video_generation.json +98 -0
  9. arena_elo/results/latest/elo_results_t2i_generation.pkl +1 -1
  10. arena_elo/results/latest/elo_results_video_generation.pkl +1 -1
  11. arena_elo/results/latest/t2i_generation_leaderboard.csv +17 -17
  12. arena_elo/results/latest/video_generation_leaderboard.csv +15 -15
arena_elo/results/20250205/clean_battle_t2i_generation.json CHANGED
@@ -116418,5 +116418,19 @@
116418
  "judge": "arena_user_10.20.34.20",
116419
  "anony": true,
116420
  "tstamp": 1738771033.7857
 
 
 
 
 
 
 
 
 
 
 
 
 
 
116421
  }
116422
  ]
 
116418
  "judge": "arena_user_10.20.34.20",
116419
  "anony": true,
116420
  "tstamp": 1738771033.7857
116421
+ },
116422
+ {
116423
+ "model_a_conv_id": "454443e672a04c6fb5fbb14ae2218b68",
116424
+ "model_b_conv_id": "8ee45d6c995844b691becc884999a996",
116425
+ "inputs": {
116426
+ "prompt": "A stylized silhouette of a person emerging from a fiery inferno, choked by smoke. Minimalist design with sharp, angular shapes. Color palette limited to shades of red, orange, and black. Smoke is represented by abstract swirling patterns. The figure's posture should convey exhaustion and struggle. Emphasis on negative space to create a sense of isolation."
116427
+ },
116428
+ "model_a": "FLUX.1-dev",
116429
+ "model_b": "PlayGround V2.5",
116430
+ "vote_type": "rightvote",
116431
+ "winner": "model_b",
116432
+ "judge": "arena_user_10.20.26.107",
116433
+ "anony": false,
116434
+ "tstamp": 1738794117.1012
116435
  }
116436
  ]
arena_elo/results/20250205/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e3bcfd78039eacd3a54402e30a95840318630890c8699cafef46032db1681e20
3
  size 88249
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:459ae3aa11515a6d8f8ae3e410cec15ab71254517006d79a15f632c447a8d2f5
3
  size 88249
arena_elo/results/20250205/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- FLUX.1-dev,FLUX.1-dev,1133.0179428192632,1135.6993466130637,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
- PlayGround V2.5,PlayGround V2.5,1115.9024334687147,1116.9263956373745,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
- FLUX.1-schnell,FLUX.1-schnell,1090.9377016794558,1097.6423661122838,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1071.655459507419,1071.3710122130817,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1053.30060506169,1052.3758863330402,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- StableCascade,StableCascade,1041.9029191901209,1044.4865223478832,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
- HunyuanDiT,HunyuanDiT,1023.1061088225898,1017.5927528557718,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
- PixArtAlpha,PixArtAlpha,1019.8520596693571,1012.2176649916935,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
- SDXL-Lightning,SDXL-Lightning,1018.7409255844768,1022.960910036447,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
- PixArtSigma,PixArtSigma,1018.5037284590167,1018.6409216893426,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- SD3,SD3,1010.9064712564536,1011.9520945132365,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
- AuraFlow,AuraFlow,999.4684963247095,996.2664418740484,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
- SDXL,SDXL,964.0415051302333,965.8440553123223,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,913.3165455298902,911.6074246152972,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),904.6337363786089,898.9387868442855,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,831.1305122613105,826.7158186522641,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,789.5828488566871,804.4306152251761,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1133.0179428192632,1134.9092246893188,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1115.9024334687147,1117.236028845854,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1090.9377016794558,1097.50071540785,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1071.655459507419,1071.4616286184028,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1053.30060506169,1052.3561567892223,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1041.9029191901209,1044.5614124410226,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1023.1061088225898,1017.6304156889324,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ PixArtAlpha,PixArtAlpha,1019.8520596693571,1012.2868832053259,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
+ SDXL-Lightning,SDXL-Lightning,1018.7409255844768,1023.0299131336908,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
+ PixArtSigma,PixArtSigma,1018.5037284590167,1018.7010204711848,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ SD3,SD3,1010.9064712564536,1011.9544412641983,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,999.4684963247095,996.1606998144014,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,964.0415051302333,965.9118706874714,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.3165455298902,911.6784467489407,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),904.6337363786089,899.0249440831645,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,831.1305122613105,826.7850477235969,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,789.5828488566871,804.5050363242589,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/20250206/clean_battle_video_generation.json ADDED
The diff for this file is too large to render. See raw diff
 
arena_elo/results/20250206/elo_results_video_generation.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7c36c04d3ac7a795967b5922f0be40041c24fbd7848fa46b043590cc7803ed7
3
+ size 81355
arena_elo/results/20250206/video_generation_leaderboard.csv ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ CogVideoX-5B,CogVideoX-5B,1144.9307996131124,1147.8191470879008,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
3
+ StableVideoDiffusion,StableVideoDiffusion,1118.2346009460055,1118.505242390246,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
4
+ Mochi1,Mochi1,1112.6510944238737,1113.4396127475216,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
5
+ Pyramid Flow,Pyramid Flow,1101.4646418114999,1104.316969248662,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
6
+ T2V-Turbo,T2V-Turbo,1055.9155485387053,1056.4562387681217,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
7
+ CogVideoX-2B,CogVideoX-2B,1050.0026255424164,1048.2042670639914,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
8
+ AnimateDiff,AnimateDiff,1039.0969140567795,1039.0578644103875,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
9
+ VideoCrafter2,VideoCrafter2,1032.1082599455224,1031.7381881472065,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
10
+ Allegro,Allegro,988.2106357295409,991.8395871871134,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
11
+ LTXVideo,LTXVideo,975.2866355415655,971.3376105477134,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
12
+ LaVie,LaVie,965.5799039152249,965.1976614430231,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
13
+ OpenSora,OpenSora,882.0868888554136,881.3717501633768,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
14
+ OpenSora v1.2,OpenSora v1.2,865.9223236394,863.5301821072767,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
15
+ AnimateDiff Turbo,AnimateDiff Turbo,836.4790421683542,834.3930313085592,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
16
+ ModelScope,ModelScope,832.0300852725821,832.7926473789018,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
arena_elo/results/latest/clean_battle_t2i_generation.json CHANGED
@@ -116418,5 +116418,19 @@
116418
  "judge": "arena_user_10.20.34.20",
116419
  "anony": true,
116420
  "tstamp": 1738771033.7857
 
 
 
 
 
 
 
 
 
 
 
 
 
 
116421
  }
116422
  ]
 
116418
  "judge": "arena_user_10.20.34.20",
116419
  "anony": true,
116420
  "tstamp": 1738771033.7857
116421
+ },
116422
+ {
116423
+ "model_a_conv_id": "454443e672a04c6fb5fbb14ae2218b68",
116424
+ "model_b_conv_id": "8ee45d6c995844b691becc884999a996",
116425
+ "inputs": {
116426
+ "prompt": "A stylized silhouette of a person emerging from a fiery inferno, choked by smoke. Minimalist design with sharp, angular shapes. Color palette limited to shades of red, orange, and black. Smoke is represented by abstract swirling patterns. The figure's posture should convey exhaustion and struggle. Emphasis on negative space to create a sense of isolation."
116427
+ },
116428
+ "model_a": "FLUX.1-dev",
116429
+ "model_b": "PlayGround V2.5",
116430
+ "vote_type": "rightvote",
116431
+ "winner": "model_b",
116432
+ "judge": "arena_user_10.20.26.107",
116433
+ "anony": false,
116434
+ "tstamp": 1738794117.1012
116435
  }
116436
  ]
arena_elo/results/latest/clean_battle_video_generation.json CHANGED
@@ -38428,5 +38428,103 @@
38428
  "judge": "arena_user_10.16.6.226",
38429
  "anony": true,
38430
  "tstamp": 1738763050.703
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38431
  }
38432
  ]
 
38428
  "judge": "arena_user_10.16.6.226",
38429
  "anony": true,
38430
  "tstamp": 1738763050.703
38431
+ },
38432
+ {
38433
+ "model_a_conv_id": "f66d4f33339746fbba50ec598327029e",
38434
+ "model_b_conv_id": "a0ab277035aa41b5a915a2dad78b8621",
38435
+ "inputs": {
38436
+ "prompt": "a person playing guitar"
38437
+ },
38438
+ "model_a": "Allegro",
38439
+ "model_b": "AnimateDiff Turbo",
38440
+ "vote_type": "rightvote",
38441
+ "winner": "model_b",
38442
+ "judge": "arena_user_10.16.28.141",
38443
+ "anony": true,
38444
+ "tstamp": 1738834984.8211
38445
+ },
38446
+ {
38447
+ "model_a_conv_id": "c4b17cec56ac478d9bd3ca69e9f2d763",
38448
+ "model_b_conv_id": "957d0f94d3cd4ae4914cb390bbebc088",
38449
+ "inputs": {
38450
+ "prompt": "a cat and a dog"
38451
+ },
38452
+ "model_a": "Mochi1",
38453
+ "model_b": "LTXVideo",
38454
+ "vote_type": "bothbad_vote",
38455
+ "winner": "tie (bothbad)",
38456
+ "judge": "arena_user_10.16.39.39",
38457
+ "anony": false,
38458
+ "tstamp": 1738835074.7384
38459
+ },
38460
+ {
38461
+ "model_a_conv_id": "00f2bb3e4010470eb438a38e8496f547",
38462
+ "model_b_conv_id": "a09cf60c9a634dbfb32e208208c05198",
38463
+ "inputs": {
38464
+ "prompt": "A happy fuzzy panda playing guitar nearby a campfire, snow mountain in the background"
38465
+ },
38466
+ "model_a": "AnimateDiff",
38467
+ "model_b": "StableVideoDiffusion",
38468
+ "vote_type": "rightvote",
38469
+ "winner": "model_b",
38470
+ "judge": "arena_user_10.16.1.166",
38471
+ "anony": true,
38472
+ "tstamp": 1738840841.5268
38473
+ },
38474
+ {
38475
+ "model_a_conv_id": "9114315f14f14f83aa65c431b2d67f43",
38476
+ "model_b_conv_id": "52184cde1c9849209ef9287883fd8c05",
38477
+ "inputs": {
38478
+ "prompt": "A person is bungee jumping"
38479
+ },
38480
+ "model_a": "Mochi1",
38481
+ "model_b": "OpenSora v1.2",
38482
+ "vote_type": "bothbad_vote",
38483
+ "winner": "tie (bothbad)",
38484
+ "judge": "arena_user_10.16.1.166",
38485
+ "anony": true,
38486
+ "tstamp": 1738840867.33
38487
+ },
38488
+ {
38489
+ "model_a_conv_id": "f7ae0e04063a41ed8c599632bc38ff7a",
38490
+ "model_b_conv_id": "b8850537b1c849168fe2649aea441f61",
38491
+ "inputs": {
38492
+ "prompt": "A person is doing laundry"
38493
+ },
38494
+ "model_a": "Pyramid Flow",
38495
+ "model_b": "AnimateDiff",
38496
+ "vote_type": "rightvote",
38497
+ "winner": "model_b",
38498
+ "judge": "arena_user_10.16.1.166",
38499
+ "anony": true,
38500
+ "tstamp": 1738840884.1354
38501
+ },
38502
+ {
38503
+ "model_a_conv_id": "ee9997e139f146ceb27517b153086705",
38504
+ "model_b_conv_id": "9ffa4e0d609a447b88b94ca27deb7c1a",
38505
+ "inputs": {
38506
+ "prompt": "A panda drinking coffee in a cafe in Paris, black and white"
38507
+ },
38508
+ "model_a": "AnimateDiff Turbo",
38509
+ "model_b": "VideoCrafter2",
38510
+ "vote_type": "rightvote",
38511
+ "winner": "model_b",
38512
+ "judge": "arena_user_10.16.28.141",
38513
+ "anony": true,
38514
+ "tstamp": 1738840910.9446
38515
+ },
38516
+ {
38517
+ "model_a_conv_id": "99082dda63a64035b554bfc94cf648d0",
38518
+ "model_b_conv_id": "58c8e65ed2dc4b93a2e2cf6f9f09dfbc",
38519
+ "inputs": {
38520
+ "prompt": "An astronaut feeding ducks on a sunny afternoon, reflection from the water."
38521
+ },
38522
+ "model_a": "Mochi1",
38523
+ "model_b": "StableVideoDiffusion",
38524
+ "vote_type": "rightvote",
38525
+ "winner": "model_b",
38526
+ "judge": "arena_user_10.16.28.141",
38527
+ "anony": true,
38528
+ "tstamp": 1738840922.9357
38529
  }
38530
  ]
arena_elo/results/latest/elo_results_t2i_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e3bcfd78039eacd3a54402e30a95840318630890c8699cafef46032db1681e20
3
  size 88249
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:459ae3aa11515a6d8f8ae3e410cec15ab71254517006d79a15f632c447a8d2f5
3
  size 88249
arena_elo/results/latest/elo_results_video_generation.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:11e07477093e02fa167b563514daf820aa0ca6261da6f3b1f6e16b10ece52ef3
3
  size 81355
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7c36c04d3ac7a795967b5922f0be40041c24fbd7848fa46b043590cc7803ed7
3
  size 81355
arena_elo/results/latest/t2i_generation_leaderboard.csv CHANGED
@@ -1,18 +1,18 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- FLUX.1-dev,FLUX.1-dev,1133.0179428192632,1135.6993466130637,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
- PlayGround V2.5,PlayGround V2.5,1115.9024334687147,1116.9263956373745,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
- FLUX.1-schnell,FLUX.1-schnell,1090.9377016794558,1097.6423661122838,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
- PlayGround V2,PlayGround V2,1071.655459507419,1071.3710122130817,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
- Kolors,Kolors,1053.30060506169,1052.3758863330402,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
- StableCascade,StableCascade,1041.9029191901209,1044.4865223478832,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
- HunyuanDiT,HunyuanDiT,1023.1061088225898,1017.5927528557718,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
- PixArtAlpha,PixArtAlpha,1019.8520596693571,1012.2176649916935,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
- SDXL-Lightning,SDXL-Lightning,1018.7409255844768,1022.960910036447,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
- PixArtSigma,PixArtSigma,1018.5037284590167,1018.6409216893426,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
- SD3,SD3,1010.9064712564536,1011.9520945132365,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
- AuraFlow,AuraFlow,999.4684963247095,996.2664418740484,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
- SDXL,SDXL,964.0415051302333,965.8440553123223,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
- SDXLTurbo,SDXLTurbo,913.3165455298902,911.6074246152972,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
- LCM(v1.5/XL),LCM(v1.5/XL),904.6337363786089,898.9387868442855,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
- OpenJourney,OpenJourney,831.1305122613105,826.7158186522641,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
- LCM,LCM,789.5828488566871,804.4306152251761,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ FLUX.1-dev,FLUX.1-dev,1133.0179428192632,1134.9092246893188,flux-1-dev-non-commercial-license (other),Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
3
+ PlayGround V2.5,PlayGround V2.5,1115.9024334687147,1117.236028845854,Playground v2.5 Community License,Playground,https://huggingface.co/playgroundai/playground-v2.5-1024px-aesthetic
4
+ FLUX.1-schnell,FLUX.1-schnell,1090.9377016794558,1097.50071540785,Apache-2.0,Black Forest Labs,https://huggingface.co/docs/diffusers/main/en/api/pipelines/flux
5
+ PlayGround V2,PlayGround V2,1071.655459507419,1071.4616286184028,Playground v2 Community License,Playground,https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic
6
+ Kolors,Kolors,1053.30060506169,1052.3561567892223,Apache-2.0,Kwai Kolors,https://huggingface.co/Kwai-Kolors/Kolors
7
+ StableCascade,StableCascade,1041.9029191901209,1044.5614124410226,stable-cascade-nc-community (other),Stability AI,https://fal.ai/models/stable-cascade/api
8
+ HunyuanDiT,HunyuanDiT,1023.1061088225898,1017.6304156889324,tencent-hunyuan-community,Tencent,https://github.com/Tencent/HunyuanDiT
9
+ PixArtAlpha,PixArtAlpha,1019.8520596693571,1012.2868832053259,openrail++,PixArt-alpha,https://huggingface.co/PixArt-alpha/PixArt-XL-2-1024-MS
10
+ SDXL-Lightning,SDXL-Lightning,1018.7409255844768,1023.0299131336908,openrail++,ByteDance,https://huggingface.co/ByteDance/SDXL-Lightning
11
+ PixArtSigma,PixArtSigma,1018.5037284590167,1018.7010204711848,openrail++,PixArt-alpha,https://github.com/PixArt-alpha/PixArt-sigma
12
+ SD3,SD3,1010.9064712564536,1011.9544412641983,stabilityai-nc-research-community,Stability AI,https://huggingface.co/blog/sd3
13
+ AuraFlow,AuraFlow,999.4684963247095,996.1606998144014,Apache-2.0,Fal.AI,https://huggingface.co/fal/AuraFlow
14
+ SDXL,SDXL,964.0415051302333,965.9118706874714,openrail++,Stability AI,https://huggingface.co/stabilityai/stable-diffusion-xl-base-1.0
15
+ SDXLTurbo,SDXLTurbo,913.3165455298902,911.6784467489407,sai-nc-community (other),Stability AI,https://huggingface.co/stabilityai/sdxl-turbo
16
+ LCM(v1.5/XL),LCM(v1.5/XL),904.6337363786089,899.0249440831645,openrail++,Latent Consistency,https://fal.ai/models/fast-lcm-diffusion-turbo
17
+ OpenJourney,OpenJourney,831.1305122613105,826.7850477235969,creativeml-openrail-m,PromptHero,https://huggingface.co/prompthero/openjourney
18
+ LCM,LCM,789.5828488566871,804.5050363242589,MIT License,Tsinghua University,https://huggingface.co/SimianLuo/LCM_Dreamshaper_v7
arena_elo/results/latest/video_generation_leaderboard.csv CHANGED
@@ -1,16 +1,16 @@
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
- CogVideoX-5B,CogVideoX-5B,1145.5303455713265,1148.4917046856542,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
3
- Mochi1,Mochi1,1115.8406775030332,1117.0595137228106,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
4
- StableVideoDiffusion,StableVideoDiffusion,1115.7552820712415,1116.1397207317902,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
5
- Pyramid Flow,Pyramid Flow,1105.7714903105714,1108.7590165652023,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
6
- T2V-Turbo,T2V-Turbo,1054.986812239954,1055.6020472628225,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
7
- CogVideoX-2B,CogVideoX-2B,1049.791340735984,1048.1606357853962,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
8
- AnimateDiff,AnimateDiff,1037.6095200753073,1037.6648620107073,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
9
- VideoCrafter2,VideoCrafter2,1030.500911653457,1030.150070853698,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
10
- Allegro,Allegro,994.1831070903168,997.917819049644,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
11
- LTXVideo,LTXVideo,976.5193012970275,970.9891011807218,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
12
- LaVie,LaVie,963.8920685462786,963.6531773897316,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
13
- OpenSora,OpenSora,880.4071068746307,879.818935686405,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
14
- OpenSora v1.2,OpenSora v1.2,864.2559797151661,861.8447842020454,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
15
- AnimateDiff Turbo,AnimateDiff Turbo,834.6240335418626,832.6050640561195,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
16
- ModelScope,ModelScope,830.3320227738413,831.1435468172468,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571
 
1
  key,Model,Arena Elo rating (anony),Arena Elo rating (full),License,Organization,Link
2
+ CogVideoX-5B,CogVideoX-5B,1144.9307996131124,1147.8191470879008,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
3
+ StableVideoDiffusion,StableVideoDiffusion,1118.2346009460055,1118.505242390246,SVD-nc-community,Stability AI,https://fal.ai/models/fal-ai/fast-svd/text-to-video/api
4
+ Mochi1,Mochi1,1112.6510944238737,1113.4396127475216,Apache 2.0,Genmo AI,https://github.com/genmoai/mochi
5
+ Pyramid Flow,Pyramid Flow,1101.4646418114999,1104.316969248662,MIT LICENSE,Peking University,https://pyramid-flow.github.io/
6
+ T2V-Turbo,T2V-Turbo,1055.9155485387053,1056.4562387681217,cc-by-nc-4.0,"University of California, Santa Barbara",https://github.com/Ji4chenLi/t2v-turbo
7
+ CogVideoX-2B,CogVideoX-2B,1050.0026255424164,1048.2042670639914,CogVideoX LICENSE,THUDM,https://github.com/THUDM/CogVideo
8
+ AnimateDiff,AnimateDiff,1039.0969140567795,1039.0578644103875,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v
9
+ VideoCrafter2,VideoCrafter2,1032.1082599455224,1031.7381881472065,Apache 2.0,Tencent AI Lab,https://ailab-cvc.github.io/videocrafter2/
10
+ Allegro,Allegro,988.2106357295409,991.8395871871134,Apache 2.0,rhymes-ai,https://github.com/rhymes-ai/Allegro
11
+ LTXVideo,LTXVideo,975.2866355415655,971.3376105477134,Apache 2.0,Lightricks,https://github.com/Lightricks/LTX-Video
12
+ LaVie,LaVie,965.5799039152249,965.1976614430231,Apache 2.0,Shanghai AI Lab,https://github.com/Vchitect/LaVie
13
+ OpenSora,OpenSora,882.0868888554136,881.3717501633768,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
14
+ OpenSora v1.2,OpenSora v1.2,865.9223236394,863.5301821072767,Apache 2.0,HPC-AI Tech,https://github.com/hpcaitech/Open-Sora
15
+ AnimateDiff Turbo,AnimateDiff Turbo,836.4790421683542,834.3930313085592,creativeml-openrail-m,"The Chinese University of Hong Kong, Shanghai AI Lab, Stanford University",https://fal.ai/models/fast-animatediff-t2v-turbo
16
+ ModelScope,ModelScope,832.0300852725821,832.7926473789018,cc-by-nc-4.0,Alibaba Group,https://arxiv.org/abs/2308.06571