The school has moved location several times since its inception. By 1693 it was located in a building to the south-east of the chapel, next to King's Parade. In this year that building was demolished and replaced with what was known as the New Brick Building which continued to house the school through to the nineteenth century. In the 1820s during the rebuilding by William Wilkins, the brick building and adjoining Provost's Lodge were demolished, opening up a view of the chapel from the street. The outline of the foundations of the brick building can be seen on the lawn during long periods of hot dry weather.