Fairlie was born in London, the fifth of seven children in a family of Scottish descent.
After taking his degree in 1945, Fairlie began his journalism career at the Manchester Evening News, followed by a brief stint working for David Astor at the Observer.