owing are our findings: 

A100
	
Resolution
Batch size
Vanilla
ToMe
ToMe + xFormers
ToMe speedup (%)
ToMe + xFormers speedup (%)
512
10
6.88
5.26
4.69
23.54651163
31.83139535







768
10
OOM
14.71
11



8
OOM
11.56
8.84



4
OOM
5.98
4.66



2
4.99
3.24
3.1
35.07014028
37.8757515

1
3.29
2.24
2.03
31.91489362
38.29787234







1024
10
OOM
OOM
OOM



8
OOM
OOM
OOM



4
OOM
12.51
9.09



2
OOM
6.52
4.96



1
6.4
3.61
2.81
43.59375
56.09375
The