Cavalieri was born in Rome of an aristocratic and musical family.
In 1587, Ferdinando de' Medici succeeded his brother as Grand Duke of Tuscany, and in 1588 he brought Cavalieri to Florence as an overseer of artists, craftsmen and musicians.