Lamb was the son of Sir Matthew Lamb, 1st Baronet, and his wife Charlotte (née Coke), and succeeded in the baronetcy on his father's death in 1768.
He inherited Melbourne Hall in Derbyshire, and in 1770 began, as Melbourne House, what is now The Albany in London.