Sanford was born Eloise Gwendolyn Sanford in Harlem, New York, to James Edward and Josephine Sanford (née Perry).
Sanford married house painter William Edward "Sonny" Richmond with whom she had three children.