 = None
attention_bias: bool = False
sample_size: typing.Optional[int] = None
activation_fn: str = 'geglu'
norm_elementwise_affine: bool = True
double_self_attention: bool = True

)


Parameters 

num_attention_heads (int, optional, defaults to 16) — The number of heads to use for multi-head attention.


attention_head_dim (int, optional, defaults to 88) — The number of channels in each head.


in_channels (int, optional) —
Pass if the input is