did we miss this most challenging MATH benchmark?

In FrontierMath:

- openAI o3-mini and o1: 11% and 9% solve rates with high reasoning effort
- claude 3.7 sonnet: 3–5% solve rate
- gpt-4o, grok 2, mistral large: near 0% solve rate

for those who don’t know, FrontierMath is a collection of 300 original challenging math problems written by expert mathematicians