Keyframing driver location results in unwanted movement of armature and animation
The OutsideOrbDriver and the armature are sharing the same action:

Then when you move the OutsideOrbDriver, and with &quot;auto keying&quot; on:

the movement impacts all the elements inside the action.