stead, you can pass the path to your local checkout to the training script and it will be loaded from there.

Hardware Requirements for Fine-tuning
	
Using gradient_checkpointing and mixed_precision it should be possible to fine tune the model on a single 24GB GPU. For higher batch_size and faster training it’s better to use GPUs with more than 30GB of GPU memory. You can also use JAX / Flax for fine-tuning on TPUs or GPUs, see below for detail