Nugee was born in 1928 in Godalming, Surrey, son of Brigadier George Nugee CBE, DSO, MC and his wife, Violet Mary.
He attended Brambletye School in East Grinstead and Radley College in Oxfordshire, from where he won a scholarship to Worcester College, Oxford, to read classics.