Seafield was the only child of John Charles Ogilvy-Grant, 7th Earl of Seafield and his wife the Hon.
The main residence for Ian Charles, as for his father and mother, was Cullen House in Cullen; Castle Grant, the traditional seat of the Clan Grant, was also occupied when his Strathspey estates were visited.