hen, add the following parameter to your training command:   Copied accelerate launch train_controlnet.py \
  --gradient_checkpointing \
  --use_8bit_adam \
</hfoption>
<hfoption id="12GB">
On a 12GB GPU, you’ll need bitsandbytes 8-bit optimizer, gradient checkpointing, xFormers, and set the gradients to None instead of zero to reduce your memory-usage.   Copied accelerate launch train_controlnet.py \
  --use_8bit_adam \
  --gradient_checkpoint