 By virtue of a special remainder granted to his father he was allowed to inherit the title of the Wilmot baronets of Osmaston.Wilmot married first Juliana Elizabeth Byron, the daughter of Admiral John Byron on 17 September 1783 at Pirbright.Julianna was the widow of her own cousin the Hon William Byron who had been MP for Morpeth.