Born in Port Republic, in Augusta County, near Staunton, Virginia, he was the son of John and Agatha (née Strother) Madison.
He read law with George Wythe, and was admitted to the bar, though he did not practice law [REF].