 The abbey may have been built by his son Edward Morgan, also a MP and High Sheriff, who was repeatedly fined for his recusancy.His son, Sir Edward Morgan, 1st Baronet was a noted Royalist during the Civil War.The second baronet, also Edward, sheltered the Jesuit priest who was executed at Usk in 1679, Saint David Lewis.