 Williams managed the Bank of Warsaw for several years, and also served as director of the Fort Wayne and Chicago Railway from 1854 to 1856, and as director of the Michigan City prison from 1859 to 1862.He served in the Union Army as commandant of Camp Allen in Fort Wayne, in 1862 and as paymaster of Volunteers, with headquarters at Louisville, Kentucky, until the close of the war.Williams was elected as a Republican to the Fortieth and to the three succeeding Congresses (March 4, 1867 – March 3, 1875).