den size of the attention layer.   cross_attention_dim (int, optional) —
The number of channels in the encoder_hidden_states.   rank (int, defaults to 4) —
The dimension of the LoRA update matrices.   network_alpha (int, optional) —
Equivalent to alpha but it’s usage is specific to Kohya (A1111) style LoRAs.   kwargs (dict) —
Additional keyword arguments to pass to the LoRALinearLayer layers.    Processor for implementing the LoRA attention mec