Clémentine Fourrier

clefourrier's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in gaia-benchmark/leaderboard 1 day ago

Missing tasks in submission counted as correct

2

#27 opened 3 days ago by

netbeards

New activity in open-llm-leaderboard/open_llm_leaderboard 2 days ago

Resubmitting a model to use `chat_template` doesn't re-evaluate, but does change `chat_template` column

3

#1066 opened about 1 month ago by

xzuyn

Are Qwen models pretrained or continuously pretrained?

7

#941 opened 5 months ago by

djstrong

Open LLM Leaderboard Evaluation isn't working for our model

1

#1087 opened 11 days ago by

FINGU-AI

tons of models are stuck in the queue

6

#1093 opened 6 days ago by

Xiaojian9992024

[FLAG] contamination MATH `bond005/meno-tiny-0.1`

1

#1094 opened 6 days ago by

fblgit

Evaluate new dolphin 3 r1 24B

1

#1097 opened 3 days ago by

djuna

slow benchmark

1

#1096 opened 3 days ago by

legolasyiu

One user.. dozens of evals.. unintentional abuse?

4

#1085 opened 11 days ago by

fblgit

New activity in open-r1/OpenR1-Math-220k 2 days ago

How do you use math verify to verify the answer's correctness? I cannot replicate one specific case

6

#5 opened 2 days ago by

lixiaonan

New activity in open-llm-leaderboard/open_llm_leaderboard 8 days ago

Suggestion

3

#1073 opened about 1 month ago by

zelk12

New activity in open-llm-leaderboard/open_llm_leaderboard 11 days ago

why evaluation is taking long time for large llm?

1

#1079 opened 24 days ago by

Imran1

Model results missing

3

#1075 opened 30 days ago by

maldv

🚩 Report: Not working

4

#1086 opened 11 days ago by

ehristoforu

New activity in deepseek-ai/DeepSeek-R1-Distill-Qwen-32B 16 days ago

Poor performance in the leaderboard?

7

#17 opened 21 days ago by

L29Ah

New activity in cais/hle 21 days ago

Please gate the dataset

3

#1 opened 22 days ago by

clefourrier

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

[Question] Are no models being evaluated due to the lighteval/MATH-Hard dataset being unavailable?

2

#1071 opened about 1 month ago by

T145

need help

2

#1061 opened about 1 month ago by

BoGoSS666

Open LLM Leaderboard Results Dataset

1

#1046 opened about 2 months ago by

natalialanzoni

Result PRs not appearing

4

#1054 opened about 2 months ago by

sometimesanotion