Can you prevent invoices from being sent via Pay Later?
If the invoice generation is linked to specific financial types, then in that the case you could create a new financial type which isn't linked to automatic invoice generation.