d or else the gain in memory consumption will only be minimal (see this issue for more information). enable_sequential_cpu_offload() is a stateful operation that installs hooks on the models.  Model offloading Model offloading requires 🤗 Accelerate version 0.17.0 or higher. Sequential CPU offloading preserves a lot of memory but it makes inference slower because submodules are moved to GPU as needed, and they’re immediately returned to the CPU 