
	
Checkpoint variants usually consist of the checkpoint stored in ”low-precision, low-storage” dtype so that less bandwith is required to download them, or of non-exponential-averaged weights that shall be used when continuing fine-tuning from the checkpoint.
Both use cases have clear advantages when their weights are considered variants: they share the same serialization format as the reference weights, and they correspond to a specialization