Live Code Bench

community

https://livecodebench.github.io/

AI & ML interests

Holistic contamination-free evaluation of Code LLMs

Recent Activity

StringChaos new activity 24 days ago

livecodebench/code_generation_lite:Remove the Loading Script & Enable the Dataset Viewer

StringChaos new activity about 1 month ago

livecodebench/code_generation_lite:fix typos

StringChaos authored a paper about 1 month ago

GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents

View all activity

livecodebench 's datasets 6

livecodebench/code_generation_lite

Updated Jun 5 • 48.6k • 53

livecodebench/execution-v2

Viewer • Updated Nov 26, 2024 • 479 • 1.34k • 3

livecodebench/code_generation

Viewer • Updated Jun 13, 2024 • 121 • 1.87k • 21

livecodebench/test_generation

Viewer • Updated Jun 13, 2024 • 442 • 1.29k • 5

livecodebench/submissions

Preview • Updated May 26, 2024 • 28

livecodebench/execution

Viewer • Updated Mar 12, 2024 • 479 • 230 • 4