lt to 0.   device (torch.Device or str, optional, defaults to “cuda”) —
The PyTorch device type of the accelerator that shall be used in inference. If not specified, it will
default to “cuda”.    Offloads all models to CPU using accelerate, reducing memory usage with a low impact on performance. Compared
to enable_sequential_cpu_offload, this method moves one whole model at a time to the GPU when its forward
method is called, and the model rema