In the 1870s, the school's governors purchased a site at the northern end of Taunton, on Staplegrove Road. They had built, by Joseph James, a gothic-influenced building, in the prevailing style of the period. The school is constructed in a C-plan, with a high tower. Grey stone came from Somerset's Mendip Hills. This large building still dominates the school's campus today. It is a Grade II listed building.