Does my LED replacement bulb need to screw in all the way?
The problem isn't the base being exposed. 

The problem is the tip not going down far enough, and arcing as a result. 

The #1 reason for this is the new bulb being wider on the bottom than the original, because of the LED driver being located there.  And it is hitting a part of the fixture.