As he had no children childless , the throne of the Duchy passed to the male descendant 's of Ernst 's late brother Albert the Prince Consort , husband of Queen Victoria . As he died childless , the throne of the duchies would have passed to the male descendants of Ernst 's late brother Albert , the Prince Consort , husband of Queen Victoria of the United Kingdom .