


8
OOM
OOM
OOM



4
OOM
OOM
19.35



2
OOM
13
10.78



1
OOM
6.66
5.54


As seen in the tables above, the speedup with tomesd becomes more pronounced for larger image resolutions. It is also interesting to note that with tomesd, it becomes possible to run the pipeline on a higher resolution, like 1024x1024. 
It might be possible to speed up inference even further with torch.compile(). 

Quality
	
As reported in the paper, ToMe can preserve th