How would I fix the moving position exactly to the part I want it to move?
in blender every object has an object origin the transform manipulators are at the pivot point and the pivot point is at the object origin (you can change where the pivot point is), if you want to move the object origin go to the Object>Transform menu there you have a couple of options, origin to geometry should do the trick.