 Through his marriage, he inherited Birdsall House

Willoughby was elected Tory Member of Parliament for Cambridge University at a by-election on 19 December 1720.He was returned unopposed again for the university at the 1722 general election.At the 1727 general election, Willoughby stood for Parliament at Tamworth on his father's interest and was elected MP.