The yeshiva was founded by the Hasidim of Grand Rabbi Avraham Mordechai Alter (Imrei Emes), the fourth Gerrer Rebbe, and was named after the Rebbe's father, Rabbi Yehuda Aryeh Leib Alter, (Sfas Emes).
The yeshiva opened with 25 students, who were soon joined by other students from Poland.