nal, defaults to 32) — The number of heads to use for multi-head attention.   attention_head_dim (int, optional, defaults to 64) — The number of channels in each head.   num_layers (int, optional, defaults to 20) — The number of layers of Transformer blocks to use.   embedding_dim (int, optional, defaults to 768) — The dimension of the model input hidden_states   num_embeddings (int, optional, defaults to 77) —
The number of embeddings of the m