

23.3s (-11.9%)
   
14.5s (-13.9%)
   



Optimized with mem. efficient attention, no compilation

92.9s (5.5%)
   
61.1s (1.2%)
   
23.9s (-1.9%)
   
20.8s (-0.1%)
   
12.8s (-0.9%)
   


Optimized with mem. efficient attention and compilation

-
   
53.1s (14.2%)
   
20.9s (10.6%)
   
18.6s (10.4%)
   
11.2s (12.2%)
   

