Keeping power on a capacitor after its charged?
I assume you are charging it with a voltage source and I further assume that you are obeying the voltage rating of the capacitor.

Under these assumptions, you are not damaging the capacitor by leaving it attached to a voltage source.