cker have their state dicts saved to CPU and then are moved to a
torch.device('meta') and loaded to GPU only when their specific submodule has its forwardmethod called. Note that offloading happens on a submodule basis. Memory savings are higher than withenable_model_cpu_offload`, but performance is lower.

enable_vae_tiling

<
source
>
(
)



Enable tiled VAE decoding.
When this option is enabled, the VAE will split the input tensor into tiles