The church was so comfortable financially that in 1852 the parish tore down its 100-year-old structure and enlarged it, using (in part) many of the stones from the first building.
Joyce also supervised the construction of the Parish House on Paterson Street, still in use today.