h block.   layers_per_block (int, optional, defaults to 2) —
The number of layers per block.   attention_head_dim (int or Tuple[int], optional, defaults to 8) —
The dimension of the attention heads.   num_attention_heads (int or Tuple[int], optional) —
The number of attention heads.   cross_attention_dim (int, optional, defaults to 768) —
The dimension of the cross attention features.   dropout (float, optional, defaults to 0) —
Dropout probabi