The congregation's first church building was erected beginning in May 1823 and consecrated a few months later on 19 November 1823 by the Rt Rev'd John Croes, Bishop of New Jersey.
According to Snell, during the forty-five-year tenures of Dunn and Pettit as rectors, "parochial statistics from 1820 to 1867 show an aggregate of 510 baptisms, 241 confirmations, 334 marriages, and 468 funerals".