Choir practice is held every week in the Crypt of St Paul 's Cathedral on the Octagon in the middle of Dunedin . Weekly rehearsals are held in the crypt of St Paul 's Cathedral on the Octagon in central Dunedin .