 defaults to 1e-5) — The epsilon to use for the normalization.


cross_attention_dim (int or Tuple[int], optional, defaults to 1280) —
The dimension of the cross attention features.


encoder_hid_dim (int, optional, defaults to None) —
If encoder_hid_dim_type is defined, encoder_hidden_states will be projected from encoder_hid_dim
dimension to cross_attention_dim.


encoder_hid_dim_type (str, optional, defaults to None) —
If given, the encoder_