.


num_attention_heads (int or Tuple[int], optional) —
The number of attention heads.


cross_attention_dim (int, optional, defaults to 768) —
The dimension of the cross attention features.


dropout (float, optional, defaults to 0) —
Dropout probability for down, up and bottleneck blocks.


flip_sin_to_cos (bool, optional, defaults to True) —
Whether to flip the sin to cos in the time embedding.


freq_shift (int, optional, defaults to 0) — T