OUTPUT_DIR="/sddata/finetune/lora/pokemon"
export HUB_MODEL_ID="pokemon-lora"
export DATASET_NAME="lambdalabs/pokemon-blip-captions"
There are some flags to be aware of before you start training:
--push_to_hub stores the trained LoRA embeddings on the Hub.
--report_to=wandb reports and logs the training results to your Weights & Biases dashboard (as an example, take a look at this report).
--learning_rate=1e-04, you can afford to use a higher l