How to fix this verterx which sticking out
An other bone has also influence on that vertex. Turn on the "Vertex selection masking", then select that vertex, and remove it from all vertex groups, then reassign to the pinky or repaint it with the weight brush.