Checkpoint variants usually consist of the checkpoint stored in ”low-precision, low-storage” dtype so that less bandwith is required to download them, or of non-exponential-averaged weights that shall be used when continuing fine-tuning from the checkpoint.