today I'm digging into mle bench

key observations:
&gt; provide task specific tools, perf deteriorates with huge number of tools

&gt; repeatedly asking to try/improve gives a huge perf boost &gt;&gt; super optimised first prompt

&gt; Pass@10 can be step change (expected)