What's the benefit the bank gets on offering me to pay my water/electricity/gas with credit card?
From a marketing point of view it's a very effective way of acquiring customers.

And you raise a good point, people often do forget these things, so banks can also profit that way.