How to delete recorded position of mesh on animation timeline?
You set the handle as a rigid body. The yellow line in the timeline shows you how much of the physics Simulation is cached. To delete the rigid body and all of the motion calculated from it Select the handle, then in the physics tab of the tool bar press remove.

You can also get to the physics settings in the physics tab of the properties window.