 Sweet was a member of the board of education from 1899 to 1906.He served as Mayor of Grand Rapids from 1904 to 1906.Sweet defeated incumbent Republican U.S. Representative Gerrit J. Diekema, to be elected as a Democrat from Michigan's 5th congressional district to the 62nd United States Congress, serving from March 4, 1911 to March 3, 1913.