36 seconds to 4.63 seconds.  In our later experiments with float16, recent versions of torchao do not incur numerical problems from float16. Take a look at the Speed up inference guide to learn more about running inference with reduced precision.  SDPA Attention blocks are intensive to run. But with PyTorch’s scaled_dot_product_attention function, it is a lot more efficient. This function is used by default in Diffusers so you don’t need to mak