is inside, every submodule of it will be sent to the
same device.
Set device_map="auto" to have 🤗 Accelerate automatically compute the most optimized device_map. For
more information about each option see designing a device
map.   max_memory (Dict, optional) —
A dictionary device identifier for the maximum memory. Will default to the maximum memory available for
each GPU and the available CPU RAM if unset.   offload_folder (str or os.PathLike, 