Little is known of Wilmot's origins, such as his exact place of birth, although he was born in England.
It was with the help of these connections that Wilmot probably became an army officer, serving in places such as Gibraltar in 1745.