 In 1771 he had the manor expanded into a castle and princely seat.His mother Mary lived in the palace until her death in 1772.In 1781, Charles sold the Rumpenheim Palace to his younger brother, Frederick.