d_act_fn: str = 'silu' norm_in_type: Optional = None embedding_proj_norm_type: Optional = None encoder_hid_proj_type: Optional = 'linear' added_emb_type: Optional = 'prd' time_embed_dim: Optional = None embedding_proj_dim: Optional = None clip_embed_dim: Optional = None  )   Parameters   num_attention_heads (int, optional, defaults to 32) — The number of heads to use for multi-head attention.   attention_head_dim (int, optional, defaults to 64)