ncoder. Since the text_encoder comes from
transformers, we cannot rejig it. That is why we have to explicitly pass the text encoder LoRA state
dict.


is_main_process (bool, optional, defaults to True) —
Whether the process calling this is the main process or not. Useful when in distributed training like
TPUs and need to call this function on all processes. In this case, set is_main_process=True only on
the main process to avoid race conditions