mother , her retinue of courtiers , maids , bodyguards , hudson the dwarf , and my little brother henry of gloucester would go to the port and secretly leave by ship for france , while father would take the rest of us , his generals , army , and ministers to his western stronghold of oxford .