 a high batch size. To reduce the memory requirement you have multiple options. The following options trade inference speed against lower memory requirement: enable model offloading: Each component of the pipeline is offloaded to CPU once it’s not needed anymore. enable feed-forward chunking: The feed-forward layer runs in a loop instead of running with a single huge feed-forward batch size reduce decode_chunk_size: This means that the VAE deco