to use for multi-head attention.


attention_head_dim (int, optional, defaults to 64) — The number of channels in each head.


num_layers (int, optional, defaults to 20) — The number of layers of Transformer blocks to use.


embedding_dim (int, optional, defaults to 768) — The dimension of the CLIP embeddings. Note that CLIP
image embeddings and text embeddings are both the same dimension.


num_embeddings (int, optional, defaults to 77) — The 