n the final model! To use this feature you need to pass the following argument to the training script:


	Copied
  --checkpointing_steps=500
This will save the full training state in subfolders of your output_dir. Subfolder names begin with the prefix checkpoint-, and then the number of steps performed so far; for example: checkpoint-1500 would be a checkpoint saved after 1500 training steps.

Resuming training from a saved checkpoint
	
If you 