He was born in Venice, the natural son of the scholar Lazare de Baïf, who was at that time French ambassador at Venice.
When he was eleven years old he was put under the care of the famous Jean Daurat.