 Irby married Dorothy Paget, only daughter of Hon.Henry Paget, second son of William Paget, 5th Baron Paget in 1706, and by her he had a son and a daughter.Irby died intestate at Kings Cliffe, Northamptonshire and was buried at Whaplode, Lincolnshire.