In 1862, at the height of the Civil War, Confederate troops occupied Tazewell as part of the greater struggle for the strategic Cumberland Gap. When the Confederates evacuated the town in November of that year, a fire followed, destroying much of Tazewell. The town retains a number of historical structures, mostly from the Victorian era, including a historic jail, built in 1819.