By default, you can keyframe the constrained object in addition to the constraint affecting it. If you want to disable this option and not allow the child object to animate, right-click the constraint and disable Dynamic Offset. This locks the position of the constrained object at its current transform, and it will now only move if the parent object moves.