rate=2e-6 \
  --lr_scheduler="constant" \
  --lr_warmup_steps=0 \
  --num_class_images=200 \
  --max_train_steps=800

Training on a 8 GB GPU:
	
Using DeepSpeed it’s even possible to offload some
tensors from VRAM to either CPU or NVME, allowing training to proceed with less GPU memory.
DeepSpeed needs to be enabled with accelerate config. During configuration,
answer yes to “Do you want to use DeepSpeed?“. Combining DeepSpeed stage 2, fp16
mixe