Voltage Drop across Diode
A diode won't do the job. The voltage drop will decrease as the current decreases leaving anything plugged in exposed to more than 5 V.

I suspect you need a LDO (low drop-out) voltage regulator with current limiting. The current limiting will protect your supply and anything else running on it.