How to connect two power sources to a switch?
simulate this circuit &ndash; Schematic created using CircuitLab

Figure 1. Wiring the components.

If your LED doesn't have built-in current limiting you will need to add a resistor  to limit the current to a safe value.