oat, defaults to 1) —
The scale factor to use for the mid block.   act_fn (str, defaults to “silu”) —
The activation function to use.   norm_num_groups (int, optional, defaults to 32) —
The number of groups to use for the normalization. If None, normalization and activation layers is skipped
in post-processing.   norm_eps (float, defaults to 1e-5) —
The epsilon to use for the normalization.   cross_attention_dim (int, defaults to 1280) —
The di