Rabbi Hillman was born in Kovno, Lithuania, the son of Paya Rivka and Avraham Chaim Hillman.
In 1897, when Rabbi Hillman was 29 years old, he became Rabbi and head of the Beth Din of Berazino in the Minsk Region of then-Russia, an old and distinguished community that had been graced with many great rabbis in the past.