In 1787 Charteris' uncle Lord Elcho (who but for his attainder would have been 6th Earl of Wemyss) died.
Charteris died on 20 January 1808 at Amisfield House, East Lothian, and was interred at St Mary's Collegiate Church, Haddington.