ion embeddings. See
ImagePositionalEmbeddings.


activation_fn (str, optional, defaults to "geglu") — Activation function to be used in feed-forward.


attention_bias (bool, optional) —
Configure if the TransformerBlocks’ attention should contain a bias parameter.


double_self_attention (bool, optional) —
Configure if each TransformerBlock should contain two self-attention layers



Transformer model for video-like data.

forward

<
source
>
(