work_alpha: Optional = None **kwargs  )   Parameters   hidden_size (int, optional) —
The hidden size of the attention layer.   cross_attention_dim (int, optional) —
The number of channels in the encoder_hidden_states.   rank (int, defaults to 4) —
The dimension of the LoRA update matrices.   attention_op (Callable, optional, defaults to None) —
The base
operator to
use as the attention operator. It is recommended to set to None, and allow xForm