Carter County is situated entirely within the Blue Ridge Mountains, specifically the Unaka Range and the Iron Mountains. Roan Mountain, which at is the highest point in Tennessee outside the Great Smoky Mountains, straddles the county's eastern border with North Carolina. The county's boundary with Sullivan County is defined as the ridgeline of Holston Mountain.