ch.nn.Module]) —
State dict of the LoRA layers corresponding to the text_encoder. Since the text_encoder comes from
transformers, we cannot rejig it. That is why we have to explicitly pass the text encoder LoRA state
dict.


is_main_process (bool, optional, defaults to True) —
Whether the process calling this is the main process or not. Useful when in distributed training like
TPUs and need to call this function on all processes. In this case, 