Greville-Bell was born in Sydney, Australia and educated at Blundell's School.
Greville-Bell married four times: to Diana Carnegie in 1945, Helen Scott-Duff in 1955, Ann Kennerley in 1972, the three marriages dissolved, and to Lauriance Rogier in 1996.