eeze more performance improvements in more recent GPU architectures such as Ampere (A100, 3090), Ada (4090) and Hopper (H100).
Compilation takes some time to complete, so it is best suited for situations where you need to prepare your pipeline once and then perform the same type of inference operations multiple times.

Benchmark
	
We conducted a simple benchmark on different GPUs to compare vanilla attention, xFormers, torch.nn.functional.scale