image   add_weighted_adapter This is an experimental method that adds PEFTs ~peft.LoraModel.add_weighted_adapter method to Diffusers to enable more efficient merging methods. Check out this issue if you’re interested in learning more about the motivation and design behind this integration. The ~peft.LoraModel.add_weighted_adapter method provides access to more efficient merging method such as TIES and DARE. To use these merging methods, make sure you have the latest stable version of Diffusers and PEFT installed.   Copied pip install -U diffusers peft There are three steps to merge LoRAs with the ~peft.LoraModel.add_weighted_adapter method: Create a ~peft.PeftModel from the underlying model and LoRA checkpoint. Load a base UNet model and the LoRA adapters. Merge the adapters using the ~peft.LoraModel.add_weighted_adapter method and the merging method of your choice. Let’s dive deeper into what these steps entail. Load a UNet that corresponds to the UNet in the LoRA checkpoint. In this case, both LoRAs use the SDXL UNet as their base model.   Copied from diffusers import UNet2DConditionModel