Holland was born at Winterslow House, Wiltshire,[REF] the son of Stephen Fox, 2nd Baron Holland, and Lady Mary, daughter of John FitzPatrick, 1st Earl of Upper Ossory, and Lady Evelyn, daughter of John Leveson-Gower, 1st Earl Gower.
He succeeded in the barony in December 1774, aged one, on the early death of his father, while his mother died shortly before his fifth birthday [REF].