James Cawthorn was the son of a Sheffield upholsterer and cabinet-maker.
In 1743 Cawthorn was made head master of Tonbridge School, by which time he had taken holy orders and sometime later was styling himself M.A.