Strange LED behavior: Why is there a voltage over the LED with only one wire connected to it?
A LED is basically a photodiode. If you shine light with the corresponding wavelength onto the LED, it will generate a voltage over the pn junction. A red LED has a bandgap of ~2V, this is propably what you are seeing here.

Try to cover the LED with one hand and check if the voltage output stays the same.