attention.


timestep ( torch.LongTensor, optional) —
Optional timestep to be applied as an embedding in AdaLayerNorm’s. Used to indicate denoising step.


class_labels ( torch.LongTensor of shape (batch size, num classes), optional) —
Optional class labels to be applied as an embedding in AdaLayerZeroNorm. Used to indicate class labels
conditioning.


encoder_attention_mask ( torch.Tensor, optional ). —
Cross-attention mask, applied to encoder