Brillstein was born to a Jewish family[REF] in Manhattan, to Moe Brillstein and Tillie Brillstein, who all shared the Manhattan home of his uncle, the vaudeville and radio performer Jack Pearl.
Brillstein attended Stuyvesant High School, graduated from New York University, and later served in the military.