str = 'layer_norm'
norm_elementwise_affine: bool = True

)


Parameters 

num_attention_heads (int, optional, defaults to 16) — The number of heads to use for multi-head attention.


attention_head_dim (int, optional, defaults to 88) — The number of channels in each head.


in_channels (int, optional) —
Pass if the input is continuous. The number of channels in the input and output.


num_layers (int, optional, defaults to 1) — The number of la