if cost can be ignored, is higher capacitor of ripple always a good choice?
A high value capacitor will cause a current surge when the device is first switched on.  The capacitor needs to charge from 0 volts to whatever the circuit voltage is, in a very short time.
In extreme cases this could cause blown diodes or blown fuses in the power supply.