oder_hid_dim
dimension to cross_attention_dim.


encoder_hid_dim_type (str, optional, defaults to None) —
If given, the encoder_hidden_states and potentially other embeddings will be down-projected to text
embeddings of dimension cross_attention according to encoder_hid_dim_type.


attention_head_dim (int, optional, defaults to 8) — The dimension of the attention heads.


num_attention_heads (int, optional) —
The number of attention heads. If n