Mary Willis Lee (27 May 1755 – 14 March 1798), daughter of Hancock Lee II & Mary Willis Catlett Madison (February 10, 1758 – March 18, 1758) Nelly Conway Madison (February 14, 1760 – December 24, 1802) William Taylor Madison (May 5, 1762 – July 20, 1843) Sarah Catlett Madison (August 17, 1764 – October 17, 1843) unnamed son (1766–1766), died one day after birth Elizabeth Madison (February 6, 1768 – May 17, 1775) unnamed stillborn son (July 12, 1770 – July 12, 1770) Reuben Madison (September 19, 1771 – June 5, 1775) Frances Taylor Madison (October 4, 1774 – October 4, 1823) American Revolutionary War During the American Revolution, Madison served as chairman of the Orange County Committee of Safety. He was commissioned as a colonel in the Virginia militia. References External links Montpelier, home of James Madison 1723 births 1801 deaths American slave owners Madison family Fathers of presidents of the United States Virginia colonial people Virginia militiamen in the American Revolution People from Orange County, Virginia