Low-Rank Adaptation of Large Language Models (LoRA)
	











Currently, LoRA is only supported for the attention layers of the UNet2DConditionalModel. We also
support LoRA fine-tuning of the text encoder for DreamBooth in a limited capacity. For more details on how we support
LoRA fine-tuning of the text encoder, refer to the discussion on this PR. 
Low-Rank Adaptation of Large Language Models (LoRA) is a training method that accelerates th