 A few years prior to his birth, Finlay's family came to South Carolina from Scotland by way of Canada.Within months of arriving in Greenville, five of the eight Finlay children died of diphtheria.James Finlay was financially well-off and, "as a gentleman farmer", operated a farm in Greenville named The Cedars.