can use enable_xformers_memory_efficient_attention() for faster inference and reduced memory consumption, as discussed here.
According to this issue, xFormers v0.0.16 cannot be used for training (fine-tune or Dreambooth) in some GPUs. If you observe that problem, please install a development version as indicated in that comment.
