or to use for the mid block.


act_fn (str, optional, defaults to "silu") — The activation function to use.


norm_num_groups (int, optional, defaults to 32) — The number of groups to use for the normalization.
If None, it will skip the normalization and activation layers in post-processing


norm_eps (float, optional, defaults to 1e-5) — The epsilon to use for the normalization.


cross_attention_dim (int or Tuple[int], optional, defaults to 1