The king 's marriage to Anne of Cleves was a disaster for Cromwell . It was the opportunity that Cromwell 's opponents ( most notably the Duke of Norfolk ) needed to press for his downfall . The King 's anger at being forced to marry Anne of Cleves was the opportunity Cromwell 's conservative opponents , most notably the Duke of Norfolk , needed to topple him .