Force to connect BNC
Those protective caps probably aren't built to the same precision as the 'scope probe connector.
You're also probably seeing the effects of the roughness or serrations on the surface of the cap where it engages the 'scope connector.
For example, see the difference in these two:


Both pictures from Amazon.