pipe.enable_model_cpu_offload() or the more aggressive layer based CPU offloading.   Copied pipe = DiffusionPipeline.from_pretrained("DeepFloyd/IF-I-XL-v1.0", variant="fp16", torch_dtype=torch.float16)