Drury was the fifth but third surviving son of Sir Robert Drury (c.1503-1577) of Hedgerley, Buckinghamshire, and Elizabeth Brudenell, the daughter of Edmund Brudenell of Chalfont St Peter, Buckinghamshire.
Drury matriculated from St Edmund's Hostel, Cambridge in Autumn 1544 [REF].