Crosse also wrote a great many poems and enjoyed walking on the Quantock Hills, in which Fyne Court is set, "at all hours of day and night, in all seasons".
Crosse advocated the benefits of education for the lower classes, argued against emigration, and supported a campaign by local farmers against falling food prices and high taxes during the 1820s.