AC-DC Switching Power adapter Unstable Voltage
Switch your multimeter to frequency measurement and see if it can pick up any ac components on the output. Better yet if you have access to an oscilloscope. Bad cap usually just won't work at all, undersized cap can cause unstable operation, or the low-pass part of power supply isn't designed properly are the options. I would discontinue use of that power supply.