Installing xFormers
	
We recommend the use of xFormers for both inference and training. In our tests, the optimizations performed in the attention blocks allow for both faster speed and reduced memory consumption.
Starting from version 0.0.16 of xFormers, released on January 2023, installation can be easily performed using pre-built pip wheels:


	Copied
pip install xformers
The xFormers PIP package requires the latest version of PyTorch (1.13.