 Wolffe was born in Dumfries on 20 December 1962 to Alexandra L. Graham and Antony C. Wolffe, MBE.He was educated at Gatehouse Primary School and then Kirkcudbright Academy.He studied at the University of Edinburgh, graduating with an honours degree in law and a diploma in legal practice.