James Jay was born in New York City; later the family moved to Rye, New York, when Peter Jay retired from business following a smallpox epidemic that had blinded two of his children [REF].
James' mother was Mary Van Cortlandt, who had married Peter Jay in 1728, in the Dutch Church [REF].