The first schoolhouse in Norwalk constructed for that purpose was built around 1678 located near what had served as the Roger Ludlow School in East Norwalk (that building is now an apartment to the northeast of the East Norwalk Historical Cemetery).
The schoolhouse at the Mill Hill site was constructed around 1826 near a former southern intersection of Willow Street and East Avenue.