A colorful trial lawyer and active in the local Democratic party, Gouldman served on the Fredericksburg City Council beginning in 1942, and was elected its president as top vote-getter in 1950.
As a legislator, Gouldman supported stronger traffic laws, a uniform teacher salary scale and opposed sales of liquor by the drink, but became best known for supporting racial segregation during the Massive Resistance crisis in Virginia.