USB li-ion charger with usb output
I would look for an external battery pack used for smartphones and tablets.
They charge with 5V and provide 5V on usb connectors.
I believe they should be easy to find at any mobile devices vendor.