Rabbi Gerstenfeld died in 1968, ending five years which Berlinski described as being "the most exciting and creative" of his life.
After his retirement in 1977, Berlinski remained in Washington and founded his own performing group, Shir Chadash Chorale, through which he was able to arrange the performance of much Jewish music in the city and the surrounding areas.