ion of the attention heads.   num_attention_heads (int or Tuple[int], optional) —
The number of attention heads.   cross_attention_dim (int, optional, defaults to 768) —
The dimension of the cross attention features.   dropout (float, optional, defaults to 0) —
Dropout probability for down, up and bottleneck blocks.   flip_sin_to_cos (bool, optional, defaults to True) —
Whether to flip the sin to cos in the time embedding.   freq_shift (int, op