 From 1861 to 1881 he served as the Rabbi of Beregszasz, Hungary and then until 1883 in his native town of Mad.He was an active participant in the rabbinical gathering in Nagymihaly in 1866 and at the congress held in Budapest in 1869.Although Rabbi Schwartz studied in the Pressburg Yeshiva whose leaders were opposed to Hasidism, he became deeply attached to Hasidism after a visit he made to Chaim Halberstam, the founder of the Sanz hasidic dynasty.