) Finally, in the training loop, the conditioning text embeddings and image are passed to the down and mid-blocks of the ControlNet model:   Copied encoder_hidden_states = text_encoder(batch["input_ids"])[0]