the rebels looted the castle and took all the walters family had , and as a result madame walter and her family could only turn to father and his court , to whom they had pledged their allegiance at the start of the war .