 In 1846 Bishop Célestine de la Hailandière purchased three lots on Georgia Street, where it intersects Tennessee Street (present-day Capitol Avenue), for $2,300.The lots served as the site for a cluster of new buildings that would be built for the parish.In 1850 a new brick church measuring by was built on the center lot facing south on Georgia Street, adjacent to the site of the present-day rectory.