In the first half of the 1740s, the house was put at the disposal of General Charles Christian Erdmann, Duke of Württemberg-Oels along with the Württemberg Mansion in Copenhagen (now Lerches Gård).
Harsdorff's mansion was destroyed by fire in 1793.