Distributed inference with multiple GPUs On distributed setups, you can run inference across multiple GPUs with 🤗 Accelerate or PyTorch Distributed, which is useful for generating with multiple prompts in parallel. This guide will show you how to use 🤗 Accelerate and PyTorch Distributed for distributed inference.  🤗 Accelerate 🤗 Accelerate is a library designed to make it easy to train or run inference across distributed setups. It simplifies t