Chichester was the son of Lord Adolphus John Spencer Churchill Chichester (18 December 1836 - 5 March 1901; a son of the 4th Marquess of Donegall) and Mary (née Dawson; died 1924).
Robert Chichester married Dehra Kerr-Fisher, later member of the Northern Ireland Parliament for Londonderry and South Londonderry.