Oliver Spencer was born at East Haddam, Connecticut on 6 October 1736.
After his father died of smallpox[REF] when Spencer was about 14 years old, he went to live with the family of Robert Ogden in Elizabethtown, New Jersey.