) are saved to CPU
and then moved to torch.device('meta') and loaded to GPU only when their specific submodule has its forward
method called. Offloading happens on a submodule basis. Memory savings are higher than with
enable_model_cpu_offload, but performance is lower.  enable_xformers_memory_efficient_attention  < source > ( attention_op: typing.Optional[typing.Callable] = None  )   Parameters   attention_op (Callable, optional) —
Override th