Joseph became an Imperial chamberlain in 1767, Lord-in-Waiting (wirklicher Kammerherr) in 1772, counsellor to the government of the Archduchy of Austria in 1774, and imperial counsellor in 1775.
He was a patron of Pavel Wranitzky (1756-1808) and other Moravian and Bohemian musicians in Vienna.