.43 3.38 (+37.75%) 2.82 (+48.07%)  1024 10 OOM OOM OOM   8 OOM OOM OOM   4 OOM OOM 19.35   2 OOM 13 10.78   1 OOM 6.66 5.54 As seen in the tables above, the speed-up from tomesd becomes more pronounced for larger image resolutions. It is also interesting to note that with tomesd, it is possible to run the pipeline on a higher resolution like 1024x1024. You may be able to speed-up inference even more with torch.compile.
