onal and memory efficiency as well as improving the quality of generated outputs. If you’re interested in making your pipeline even faster, take a look at the following resources: Learn how PyTorch 2.0 and torch.compile can yield 5 - 300% faster inference speed. On an A100 GPU, inference can be up to 50% faster! If you can’t use PyTorch 2, we recommend you install xFormers. Its memory-efficient attention mechanism works great with PyTorch 1.13.