er to maximum memory. Will default to the maximum memory available for each
GPU and the available CPU RAM if unset.


offload_folder (str or os.PathLike, optional) —
If the device_map contains any value "disk", the folder where we will offload weights.


offload_state_dict (bool, optional) —
If True, will temporarily offload the CPU state dict to the hard drive to avoid getting out of CPU
RAM if the weight of the CPU state dict + the biggest sh