 He was elected again in the second election of 1679 for the Second Exclusion Parliament and in 1681.Irby married firstly, in 1623, Frances Wray, daughter of Sir William Wray, 1st Baronet, and had by her an only daughter, Elizabeth, who married Hon.George Montagu.