Frederick's uncle, Charles Henry Hall, was dean of Christ Church, Oxford, and the boy was educated successively at Eton College and Harrow School, and destined for the church.
After studying at Sass's school and at the Royal Academy he went to Paris, and worked for a time under Horace Vernet, also frequenting the studio of Vernet's son-in-law, Paul Delaroche.