rtant to not move the pipeline to CUDA beforehand or else the gain in memory consumption will only be minimal. See this issue for more information.


Model offloading for fast inference and memory savings
	
Sequential CPU offloading, as discussed in the previous section, preserves a lot of memory but makes inference slower, because submodules are moved to GPU as needed, and immediately returned to CPU when a new module runs.
Full-model offloadi