Freeman came from a middle-class, non-conformist background, the family involved in importing tobacco and manufacturing cigars.
He and his sister Daisy spent a year at the Quaker Settlement in Woodbrooke, Birmingham and thereafter he began to do extramural work in tutorial classes for the Universities of Sheffield, London and Oxford,.