checkpoint, pass the following argument to the training script:


	Copied
--checkpointing_steps=500
The full training state is saved in a subfolder in the output_dir every 500 steps, which allows you to load a checkpoint and resume training if you pass the --resume_from_checkpoint argument to the training script:


	Copied
--resume_from_checkpoint="checkpoint-1500"

Finetuning
	
You’re ready to launch the training script now! Specify the datase