 The tavern was built as a residence in 1794 by Joseph Whiton, a local militia commander.It was one of the first brick houses of the Federal period in the region, with some of its design elements taken from the published drawings of Asher Benjamin.It was acquired in 1815 by the Merrell family, who would operate it has a tavern for over a century.