aults to 1) — The scale factor for the mid block.


downsample_padding (int, optional, defaults to 1) — The padding for the downsample convolution.


act_fn (str, optional, defaults to "silu") — The activation function to use.


attention_head_dim (int, optional, defaults to 8) — The attention head dimension.


norm_num_groups (int, optional, defaults to 32) — The number of groups for the normalization.


norm_eps (float, optional, defaults to 