Pritchard was born in Hampstead, son of Clive Fleetwood Pritchard, a successful barrister, and thus a descendent of Andrew Pritchard, businessman and scientist.
For many years he and his wife lived in the famous Lawn Road Flats, also known as the Isokon Flats.