Hay was the third son of George Hay-Drummond, 12th Earl of Kinnoull and Lady Emily Somerset, daughter of Henry Somerset, 7th Duke of Beaufort [REF].
He was commissioned into the Royal Perthshire Militia in 1872 and later joined the Black Watch, with whom he fought in the 1882 Anglo-Egyptian War.