indeed , his liaison with mrs jordan , the actress , had certainly produced a large family , but now , with no royal heir , apart from the childless duke of york , the royal brothers had to do their duty , and an added incentive to change their single status was parliament agreeing to settle their debts , or part of them .