Mary "Polly" Norris was born on July 17, 1740 in Philadelphia, Pennsylvania, the daughter of Isaac and Sarah (née Logan) Norris.
Norris was well-educated and owned one of the largest libraries in the colonies at the time, holding approximately 1,500 books, as well as personal and real property, including the estate of Fair Hill in the Philadelphia area.