In 1972, the same year that he graduated from law school, Harkin returned to Iowa and immediately ran against an incumbent Republican Congressman, William J. Scherle.
After his 1972 defeat, Harkin practiced law in Ames before seeking a rematch against Scherle in 1974.