u’re training on more than one GPU, add the --multi_gpu parameter to the accelerate launch command.
<hfoptions id="gpu-select">
<hfoption id="16GB">
On a 16GB GPU, you can use bitsandbytes 8-bit optimizer and gradient checkpointing to optimize your training run. Install bitsandbytes:   Copied pip install bitsandbytes Then, add the following parameter to your training command:   Copied accelerate launch train_controlnet.py \
  --gradient_checkpo