ntion(attention_op=None)

disable_xformers_memory_efficient_attention

<
source
>
(
)



Disable memory efficient attention as implemented in xformers.

enable_model_cpu_offload

<
source
>
(
gpu_id = 0

)



Offloads all models to CPU using accelerate, reducing memory usage with a low impact on performance. Compared
to enable_sequential_cpu_offload, this method moves one whole model at a time to the GPU when its forward
method is called, and t