Harvey was born in Evanston, Illinois to William Dow Harvey and Lucy Smith Harvey as the youngest of five siblings on April 25, 1938.
Harvey returned to the U.S. in 1969 and enrolled in the University of North Carolina's masters degree program in family planning administration.