Hard to catch a vertex because of the gizmo
Credit for the following answer goes to Yegor Smirnov who tweeted about this. 

The solution for this problem is to set the Activate Gizmo to Drag in Keymap > Preferences. 

The tooltip explains what it does:


  Drag allows click events to pass through to the tool, adding a small
  delay.