

Latency
Speedup
original
9.50s
x1
fp16
3.61s
x2.63
channels last
3.30s
x2.88
traced UNet
3.21s
x2.96
memory efficient attention
2.63s
x3.61
obtained on NVIDIA TITAN RTX by generating a single image of size 512x512 from
  the prompt "a photo of an astronaut riding a horse on mars" with 50 DDIM
  steps.


Use tf32 instead of fp32 (on Ampere and later CUDA devices)
	
On Ampere and later CUDA devices matrix multiplications and convolutions can us