The town, founded in 1858 upon the formation of Buchanan County, was named for Felix Grundy (1777-1840), United States Attorney General (1838-1839) and United States Senator from Tennessee (1839-1840).
Since 1929, Grundy has suffered nine major floods of the adjoining Levisa Fork River.