Through his mother Grayson was a cousin to James Monroe.
Spence Grayson's son John Robinson Grayson (born in 1779 at Belle Aire), was captured near the Occoquan River from the brig Polly, operated by Lund Washington.