 can’t use PyTorch 2, we recommend you install xFormers. Its memory-efficient attention mechanism works great with PyTorch 1.13.1 for faster speed and reduced memory consumption. Other optimization techniques, such as model offloading, are covered in this guide.
