Many of the buildings in Market Street, the town's main thoroughfare, are timber framed, but most of this is hidden by later brick facades.
A local high school, Ivanhoe College, for 11 to 14-year-olds, is named after the historical novel Ivanhoe by Sir Walter Scott which was set in the area of the castle.