tensors 0:00:02.033658"
"Loaded in PyTorch 0:00:02.663379" But the actual time it takes to load 500MB of the model weights is only:   Copied safetensors: 3.4873ms
PyTorch: 172.7537ms Lazy loading is also supported in safetensors, which is useful in distributed settings to only load some of the tensors. This format allowed the BLOOM model to be loaded in 45 seconds on 8 GPUs instead of 10 minutes with regular PyTorch weights.
