Sudeley Castle was mainly built in 1441 by Ralph Boteler , who had the castle confiscated by Edward IV of England . Edward gave Sudeley Castle to his brother , who later became Richard III of England , who then gave it to his uncle Jasper Tudor , Duke of Bedford . In 1469 , Edward IV of England confiscated the castle from its owner , Ralph Boteler , 1st Baron Sudeley and gave it to his brother , the Duke of Gloucester , who later became Richard III of England .