to the config to have a successful training run.
Enable the following optimizations to train on a 8GB GPU:
Gradient checkpointing
bitsandbyte’s 8-bit optimizer (take a look at the [installation]((https://github.com/TimDettmers/bitsandbytes#requirements—installation) instructions if you don’t already have it installed)
xFormers (take a look at the installation instructions if you don’t already have it installed)
set gradients to None
DeepSpeed s