trying to wire a light fixture in a 1923 house with knob and tube wiring
Do not trust the voltage pen to be accurate. I've seen them light up when I have had the entire house power turned off. I got out a real mulit-meter, and it showed that it was dead. Even though the voltage stick still lit up.  Verify with an actual meter. This very well might change the story.