 He was selectman 1789-1791; county solicitor for Cheshire County in 1794; and member of the New Hampshire House of Representatives in 1797.Sprague was elected as a Federalist Party to the 5th United States Congress to fill the vacancy caused by the resignation of Jeremiah Smith, serving from December 15, 1797, to March 3, 1799.He declined to be a candidate for renomination in 1798.