). See the DeepSpeed documentation for more configuration options.
Changing the default Adam optimizer to DeepSpeed’s special version of Adam
deepspeed.ops.adam.DeepSpeedCPUAdam gives a substantial speedup, but enabling
it requires the system’s CUDA toolchain version to be the same as the one installed with PyTorch. 8-bit optimizers don’t seem to be compatible with DeepSpeed at the moment.


	Copied
export MODEL_NAME="CompVis/stable-diffusion-v