The situation changed again with the new French invasion of Louis XII. While the Neapolitan king Frederick IV fled to the island of Ischia, Fabrizio and Prospero Colonna tried to defend the kingdom. They were defeated and imprisoned in the Castel Nuovo of Naples. They were also excommunicated by Alexander VI, who took their castles in the Lazio. Eventually ransomed, both cousins then entered the service of the Spanish general Gonzalo Fernández de Córdoba, viceroy of Naples.