Capacitor discharging dilemma!
Assuming ideal components, the capacitor will discharge into the power supply until the capacitor reaches 5V. Yes, this means that the supply will have a negative current. This is not a violation of reality; this is the technique used to charge rechargeable batteries (although that uses controlled conditions rather than just shoving a capacitor across it).