Weird rotation problem
So as switching to Quaternion would remove the animation, I guess the easiest way is to create additional keyframes so that Blender knows better how to interpolate.
For example it begins to mess up at frame 9:

So move and rotate the bone correctly and create a keyframe (i):

Keep on doing it at frame 10 and 11, then you can come back and see if you can delete some.