The eldest son and heir of the 1st Duke and 4th Earl by his first wife, Lady Jane, daughter of William Douglas, 1st Marquess of Douglas, he was educated at the Scots College, (Paris).
In 1689 he accompanied King James II of England, and VII of Scotland, to Ireland, and afterwards joined Lord Mar during the 1715 Uprising in Scotland.