most optimized device_map automatically, set device_map="auto". For
more information about each option see designing a device
map.


low_cpu_mem_usage (bool, optional, defaults to True if torch version >= 1.9.0 else False) —
Speed up model loading by not initializing the weights and only loading the pre-trained weights. This
also tries to not use more than 1x model size in CPU memory (including peak memory) while loading the
model. This is only