When I parent an object with a bone the object moves its place
You must have parented the object with a bone that is not in Rest pose, so first select your bone in Pose mode and altG, altR, altS to reset its location, rotation and scale.