Perry was born in Norwich in 1793; his father was a turner and an amateur bass singer who took part in the annual performance of an oratorio at the cathedral, under John Christmas Beckwith.
About 1818 Perry became leader of the orchestra at the Theatre Royal, Norwich, then an institution enjoying a high reputation.