open-llm-leaderboard/open_llm_leaderboard

#796 opened 8 months ago by

rombodawg

💬 Discussion thread: Model contamination techniques 💬

pinned

34

#472 opened about 1 year ago by

clefourrier

💎 Resources and community initiatives around the Leaderboard! 💎

pinned

#174 opened over 1 year ago by

clefourrier

Evaluate new dolphin 3 r1 24B

#1097 opened about 14 hours ago by

djuna

slow benchmark

#1096 opened about 16 hours ago by

legolasyiu

[FLAG] contamination MATH `bond005/meno-tiny-0.1`

#1094 opened 3 days ago by

fblgit

tons of models are stuck in the queue

#1093 opened 4 days ago by

Xiaojian9992024

no Eval for L3.3 70b based model

#1091 opened 4 days ago by

Steelskull

Open LLM Leaderboard Evaluation isn't working for our model

#1087 opened 8 days ago by

FINGU-AI

One user.. dozens of evals.. unintentional abuse?

#1085 opened 8 days ago by

fblgit

Need help doing eval- they keep failing

#1083 opened 12 days ago by

SicariusSicariiStuff

Unable to submit byroneverson/Yi-1.5-34B-Chat-abliterated

#1080 opened 21 days ago by

CombinHorizon

Qwen2.5-32B merge eval error

#1078 opened 23 days ago by

ehristoforu

Model results missing

#1075 opened 27 days ago by

maldv

The quota has been exceeded.

5

#1074 opened 28 days ago by

lunahr

Suggestion

#1073 opened 28 days ago by

zelk12

fix-gptq

#1072 opened 28 days ago by

alozowski

Bug in Parameters count for GPTQ quantized model

#1068 opened about 1 month ago by

Qubitium

Resubmitting a model to use `chat_template` doesn't re-evaluate, but does change `chat_template` column

#1066 opened about 1 month ago by

xzuyn

failed models, check logs

#1062 opened about 1 month ago by

CombinHorizon

docker-container-test

#1047 opened about 2 months ago by

alozowski

Normalization for MuSR object placement

#1040 opened 2 months ago by

recojt

update ranking number when editing filters

#1036 opened 2 months ago by

clem

Requested feature: searchable tags for official supported languages for each model.

#1035 opened 2 months ago by

Reza2kn

Proposal for new column

#1032 opened 2 months ago by

Yuma42

I can't replicate results.

5

#1016 opened 3 months ago by

Pretergeek

merged models marked as non merged in the leaderboard

#993 opened 4 months ago by

fblgit

Feature Request: change request file format to disambiguate chat and non-chat models?

#954 opened 4 months ago by

CombinHorizon

Are Qwen models pretrained or continuously pretrained?

7

#941 opened 5 months ago by

djstrong

Feature request: Add toggle to only show models with linked dataset

#763 opened 9 months ago by

ThiloteE

Feature request: Hide models with insufficient model card from default view in leaderboard

#762 opened 9 months ago by

ThiloteE

Discussion: naming pattern to converge on to better identify fine-tunes

17

#761 opened 9 months ago by

ThiloteE

Crowd-Source Hardware for the LeaderBoard?

#570 opened about 1 year ago by

ibivibiv

Feature request: Using weights hash to identify duplicates

#422 opened about 1 year ago by

mrfakename

Tool: Adding evaluation results to model cards

47

#370 opened over 1 year ago by

Weyaxi

Feature suggestion: average of selected (rather than all) columns