Pearlman was born and raised in Flushing, New York, the only child of Jewish parents, Hy Pearlman, who ran a dry cleaning business, and Reenie Pearlman, a school lunchroom aide.
His cousin Garfunkel's fame and wealth helped fire Pearlman's own interest in the music business.