e., query,
key, value) are fused. For cross-attention modules, key and value projection matrices are fused. This API is 🧪 experimental.  set_attention_slice  < source > ( slice_size  )   Parameters   slice_size (str or int or list(int), optional, defaults to "auto") —
When "auto", input to the attention heads is halved, so attention is computed in two steps. If
"max", maximum amount of memory is saved by running only one slice at a time. If a n