ffload the CPU state dict to the hard drive to avoid getting out of CPU
RAM if the weight of the CPU state dict + the biggest shard of the checkpoint does not fit. Defaults to
True when there is some disk offload.


low_cpu_mem_usage (bool, optional, defaults to True if torch version >= 1.9.0 else False) —
Speed up model loading by not initializing the weights and only loading the pre-trained weights. This
also tries to not use more than 1x mod