Are reasoning models better at reasoning or memorization? 

Our new reasoning benchmark L2 tests R1,  o1, o3-mini, GPT 4.5 and Claude 3.7 Sonnet. 

None of the models performs well but Claude 3.7 Sonnet outperforms o1-preview and  R1 by a larger margin!