How do I fix the pivot point of my vertex
This is because the armature modifier is not taken into account (this is intended behavior), so the pivot point is at the non modified location of the selection.

This becomes obvious when toggling Modified edit cage (the triangle icon on the modifier):



To make things more manageable, try disabling the modifier in edit mode:



Also see Why is vertex snapping with auto merge enabled not merging vertices?