Why would lights plugged in to lamp holder outlet adapter be testing as live?
I would advise checking the wiring of the switch.  It sounds like it might be a case of the switch for the lamp is switching the neutral instead of hot. The result of this is that when the switch is off, there is no visible light because there is no return path for the electricity (broken by the switch), but there is still eletricity making it up to the fixture.