 at once is to simply try it out, and see when we get a “Out-of-memory (OOM)” error.                                                                                                          
We can run batched inference by simply passing a list of prompts and generators. Let’s define a quick function that generates a batch for us.                                                                                                


	Copied
def get_i