The North Branch starts at Fairfax Stone in West Virginia , and the South Branch starts in Highland County , Virginia . The source of the North Branch is at the Fairfax Stone located at the junction of Grant , Tucker , Preston counties in West Virginia . The source of the South Branch is located near Hightown in northern Highland County , Virginia .