Portman was the elder son of Hon Michael Berkeley Portman (born 20 January 1906, died 25 October 1959) and the grandson of Gerald Berkeley Portman, 7th Viscount Portman.
Portman inherited the viscountcy on the death of his uncle in 1967.