Do chargers use power when they're not charging?
If you don't connect a charger to the device it's meant to charge, there will be very little electricity flowing through the charger. (There will be a little bit leaking through, but it's usually not significant.)

As a rule of thumb, if your charger doesn't feel warm, it's probably not using enough current to affect your power bill.