Woolf was born in Newcastle-upon-Tyne, England, on 2 May 1933, to Alexander Susman Woolf and his wife Leah (née Cussins).
Woolf formed much of his sense of justice and fairness from his experiences at Fettes College.