hardware but works great on GPUs too. The Flax training script doesn’t support features like gradient checkpointing or gradient accumulation yet, so you’ll need a GPU with at least 30GB of memory or a TPU v3.
Before running the script, make sure you have the requirements installed:


	Copied
pip install -U -r requirements_flax.txt
Specify the MODEL_NAME environment variable (either a Hub model repository id or a path to the directory containing