flip_sin_to_cos (bool, optional, defaults to True) —
Whether to flip the sin to cos in the time embedding.   freq_shift (int, optional, defaults to 0) — The frequency shift to apply to the time embedding.   use_memory_efficient_attention (bool, optional, defaults to False) —
Enable memory efficient attention as described here.   split_head_dim (bool, optional, defaults to False) —
Whether to split the head dimension into a new axis for the self