768) so the array is split into 8 and each copy of _generate receives an input with shape (1, 77, 768). The most important thing to pay attention to here is the batch size (1 in this example), and the input dimensions that make sense for your code. You don’t have to change anything else to make the code work in parallel. The first time you call the pipeline takes more time, but the calls afterward are much faster. The block_until_ready function