 of before you start training:
--push_to_hub stores the trained LoRA embeddings on the Hub.
--report_to=wandb reports and logs the training results to your Weights & Biases dashboard (as an example, take a look at this report).
--learning_rate=1e-04, you can afford to use a higher learning rate than you normally would with LoRA.
Now you’re ready to launch the training (you can find the full training script here):


	Copied
accelerate launch tra