eir state dicts saved to CPU and then are moved to a torch.device('meta') and loaded to GPU only when their specific submodule has its forwardmethod called. Note that offloading happens on a submodule basis. Memory savings are higher than withenable_model_cpu_offload`, but performance is lower.

enable_vae_slicing

<
source
>
(
)



Enable sliced VAE decoding.
When this option is enabled, the VAE will split the input tensor in slices to compute