isable_xformers_memory_efficient_attention

<
source
>
(
)



Disable memory efficient attention as implemented in xformers.

enable_attention_slicing

<
source
>
(
slice_size: typing.Union[str, int, NoneType] = 'auto'

)


Parameters 

slice_size (str or int, optional, defaults to "auto") —
When "auto", halves the input to the attention heads, so attention will be computed in two steps. If
"max", maxium amount of memory will be saved by runnin