




Original without xFormers

30.4s (-19.3%)
   
29.8s (-77.3%)
   
13.0s (-83.9%)
   
10.9s (-33.1%)
   
8.0s (-19.3%)
   


Original with xFormers

25.5s (0.0%)
   
16.8s (0.0%)
   
7.1s (0.0%)
   
8.2s (0.0%)
   
6.7s (0.0%)
   


Optimized with vanilla math attention, no compilation

27.3s (-7.0%)
   
19.9s (-18.7%)
   
13.2s (-87.2%)
   
7.5s (8.7%)
   
5.7s (15.1%)
   


Optimized with mem. efficient attention, no compilation

26.5s (-3.8%)
   
16.8s (0.2%)
   
7.1s (-0.8%)
   
6.9s (16.0%)
   
5.3s (20.6%)
   
