itionOutput if return_dict is True, otherwise a tuple. When
returning a tuple, the first element is the sample tensor.



set_attention_slice

<
source
>
(
slice_size

)


Parameters 

slice_size (str or int or list(int), optional, defaults to "auto") —
When "auto", halves the input to the attention heads, so attention will be computed in two steps. If
"max", maximum amount of memory will be saved by running only one slice at a time. If a numbe