The prince-electors, perturbed by the rise of the Luxembourgs, disregarded the claims raised by Henry's heir King John, and the rule over the Empire was assumed by the Wittelsbach duke Louis of Bavaria.
The family's decline began under Charles' son King Wenceslaus, deposed by the prince-electors in 1400 who chose the Wittelsbach Elector Palatine Rupert.