The Inn was originally built in 1824-25 by John McKinney, a local lawyer and businessman, to compete with the tavern operated by the founder of Rogersville, Joseph Rogers. Rogers' Tavern was originally located a few hundred feet off the Great Stage Road that ran through the new town to Knoxville, Tennessee toward the Cumberland Gap. In 1815, Rogers built a newer building directly on the Stage Road; neither building, however, was very substantial, and there were minimal guest rooms.