 Born in Port Republic, in Augusta County, near Staunton, Virginia, he was the son of John and Agatha (née Strother) Madison.He was educated at home and at a private school in Maryland, before attending the College of William and Mary in Williamsburg, Virginia where he graduated with high honors in 1771.On July 29, 1772, he received the gold medal given as a prize for classical learning by the Royal Governor of Virginia, Norborne Berkeley, 4th Baron Botetourt, who is better known in Virginia as "Lord Botetourt".