Population growth to the town was slow at first. In 1810, the town had a population of 250, and by 1860 that number had grown to 457. The town maintained a steady stream of visitors primarily due to its position on Three Notch'd Road, which connected Staunton to the west with Charlottesville and Richmond to the east. This road crossed the Blue Ridge Mountains through Jarman's Gap. Additionally, a railroad tunnel was constructed through Rockfish Gap a short time before the Civil War began. This was to establish Rockfish Gap as the major crossing through the mountains between Waynesboro and Charlottesville.