In 1839 Williams first entered public service serving as justice of the peace of Vincennes, Indiana until he resigned in 1843.
During the American Civil War, Williams was accused of being a Copperhead when he attempted to interfere with the war effort and submitted legislation to require Governor Oliver Morton to show what the money in the state emergency fund was being spent on [REF].