5fa1a76
1
2
3
4
5
6
yaml { "zero_force_ds_cpu_optimizer": false } DeepSpeed supports the LRRangeTest, OneCycle, WarmupLR and WarmupDecayLR learning rate schedulers.
