 Weights & Biases dashboard (as an example, take a look at this report).
--learning_rate=1e-04, you can afford to use a higher learning rate than you normally would with LoRA.
Now you’re ready to launch the training (you can find the full training script here):


	Copied
accelerate launch --mixed_precision="fp16"  train_text_to_image_lora.py \
  --pretrained_model_name_or_path=$MODEL_NAME \
  --dataset_name=$DATASET_NAME \
  --dataloader_num_wo