Jeffrey was baptised in Oakham in Rutland on 14 June 1619.
On his seventh birthday, in 1626, Jeffrey Hudson was presented to the Duchess of Buckingham as a "rarity of nature" and she invited him to join the household.