The couple lived in the family plantation farm in Tennessee . There in 1834 , a fire destroyed the main house . The couple remained at the Hermitage managing the plantation until a fire destroyed much of the main house in 1834 .