oder_hid_dim (int, optional, defaults to None):
If encoder_hid_dim_type is defined, encoder_hidden_states will be projected from encoder_hid_dim
dimension to cross_attention_dim.
encoder_hid_dim_type (str, optional, defaults to None):
If given, the encoder_hidden_states and potentially other embeddings are down-projected to text
embeddings of dimension cross_attention according to encoder_hid_dim_type.
attention_head_dim (int, optional, default