 a given module name is inside, every submodule of it will be sent to the
same device.
To have Accelerate compute the most optimized device_map automatically, set device_map="auto". For
more information about each option see designing a device
map.


low_cpu_mem_usage (bool, optional, defaults to True if torch version >= 1.9.0 else False) —
Speed up model loading by not initializing the weights and only loading the pre-trained weights. This
als