Mary Jefferson was born to politician and future president Thomas Jefferson and Martha Wayles Skelton Jefferson (née Wayles).
She had a sickly disposition as her mother did, who died in 1782 when Polly was five.