rom_flax.
It is required to be logged in (huggingface-cli login) when you want to use private or gated
models

enable_attention_slicing

<
source
>
(
slice_size: typing.Union[str, int, NoneType] = 'auto'

)


Parameters 

slice_size (str or int, optional, defaults to "auto") —
When "auto", halves the input to the attention heads, so attention will be computed in two steps. If
"max", maximum amount of memory will be saved by running only one sli