tion id="12GB">
On a 12GB GPU, you’ll need bitsandbytes 8-bit optimizer, gradient checkpointing, xFormers, and set the gradients to None instead of zero to reduce your memory-usage.   Copied accelerate launch train_dreambooth.py \
  --use_8bit_adam \
  --gradient_checkpointing \
  --enable_xformers_memory_efficient_attention \
  --set_grads_to_none \
</hfoption>
<hfoption id="8GB">
On a 8GB GPU, you’ll need DeepSpeed to offload some of the tens