oder_hid_dim_type (str, optional, defaults to None):
If given, the encoder_hidden_states and potentially other embeddings are down-projected to text
embeddings of dimension cross_attention according to encoder_hid_dim_type.
attention_head_dim (int, optional, defaults to 8): The dimension of the attention heads.
num_attention_heads (int, optional):
The number of attention heads. If not defined, defaults to attention_head_dim
resnet_time_scale_sh