How to merge or move two vertices without affecting the others?
As I see, you are using Ctrl + mouse click instead Shift + mouse click  for selecting multiple vertexes.  Ctrl + mouse click is a Pick Shortest Path function and select road from vertex to vertex.

To add vertex to selection use Shift + mouse click