Spaces:
Running
Running
| model_name,coding,creative writing,current news,general culture,grammar,history,logics,math,science,technology,Average (All Topics) | |
| claude-3.5-haiku-20241022,23.7,19.75,19.06,20.65,15.82,17.31,15.7,21.4,13.3,13.16,17.98 | |
| claude-3.7-sonnet,34.5,42.15,35.2,24.45,22,41.91,32.66,45.31,21,29.41,32.86 | |
| claude-3.7-sonnet:thinking,122.38,86.02,45.39,56.93,59.81,58.5,137.09,145.15,53.35,61.38,82.6 | |
| deepSeek-R1,265.87,557.13,73,123.61,195.61,68.46,393.58,391.41,97.07,68.91,223.47 | |
| deepSeek-V3,489.39,52.4,48.32,63.66,57.52,64.71,72.51,89.72,35.64,91.46,106.53 | |
| deepSeek-V3-0324,132.59,60.61,92.63,98.62,64.37,68.91,202.2,230.86,136.28,318.33,140.54 | |
| gemini-2.0-flash-001,13.29,6.62,7.15,7.43,9.12,6.65,10.66,12.31,7.46,7.56,8.82 | |
| gemini-2.5-pro-preview-03-25,78.66,32.41,37.16,59.49,48.05,40.25,128.55,137.5,39.82,39.92,64.18 | |
| gemma-3-27b-it,205.53,47.1,49.13,39.73,59.89,77.24,62.05,98.21,80.09,72.23,79.12 | |
| gpt-4.1-mini,39.52,15.25,20.58,32.46,25.08,28.67,36.87,52.4,19.65,21.41,29.19 | |
| gpt-4o-mini,31.65,18.1,16.75,19.07,20.07,22.09,17.86,37.33,17.63,16.96,21.75 | |
| grok-2-1212,25.85,12.72,13.91,17.66,17.06,17.54,28.11,72.73,13.08,14.55,23.32 | |
| grok-3-beta,80.37,50.31,69.86,44.77,81.45,56.9,90.91,87.52,45.89,89.96,69.79 | |
| llama-3.1-Nemotron-70B-Instruct-HF,65.57,29.35,29.17,33.06,35.17,29.16,44.7,165.37,28.79,27.03,48.74 | |
| llama-3.3-70B-Instruct,83.59,53.04,79.05,70.62,70.25,57.85,69.79,117.32,77.75,57.72,73.7 | |
| llama-3_1-Nemotron-Ultra-253B-v1,157.34,41.92,48.86,54.35,55.23,43.9,205.29,236.74,51.17,49.75,94.45 | |
| llama-4-Maverick-17B-128E-Instruct-FP8,80.03,10.11,13.5,15.19,12.64,13.25,18.17,42.55,12.47,13.21,23.11 | |
| llama-4-Scout-17B-16E-Instruct,26.4,9.28,10.96,11.67,9.58,12,14.52,20.09,10.46,13.2,13.82 | |
| mistral-large-2411,157.72,54.36,82.25,77.68,69.55,160.87,136.52,98.81,29.76,100.24,96.77 | |
| mistral-small-24b-instruct-2501,36.17,26.9,21.63,20.29,16.93,19.97,32.45,75.08,21.31,25.44,29.62 | |
| nova-lite-v1,12.92,5.83,32.65,6.61,6.51,5.7,9.03,19.28,7.8,18.38,12.47 | |
| nova-pro-v1,15.72,11.25,6.86,10.76,7.67,8.17,9.15,14.68,6.84,8.2,9.93 | |
| o3-mini-2025-01-31,35.06,16.4,16.14,20.01,18.56,14.95,39.78,52.4,13.09,10.28,23.67 | |
| o4-mini-2025-04-16,57.74,39.5,24.57,39.62,48.97,33.24,70.85,164.19,25.11,19.22,52.3 | |
| qwen-plus,77.04,72.72,55.77,55.36,69.05,48.73,68.49,121.78,41.3,56.74,66.7 | |