 defaults to 2) —
The number of layers per block.


attention_head_dim (int or Tuple[int], optional, defaults to 8) —
The dimension of the attention heads.


cross_attention_dim (int, optional, defaults to 768) —
The dimension of the cross attention features.


dropout (float, optional, defaults to 0) —
Dropout probability for down, up and bottleneck blocks.


flip_sin_to_cos (bool, optional, defaults to True) —
Whether to flip the sin to cos i