tention_head_dim
must be a multiple of slice_size.



Enable sliced attention computation.
When this option is enabled, the attention module will split the input tensor in slices, to compute attention
in several steps. This is useful to save some memory in exchange for a small speed decrease.

disable_attention_slicing

<
source
>
(
)



Disable sliced attention computation. If enable_attention_slicing was previously invoked, this method will g