Goodman was born in Chicago, the ninth of twelve children of poor Jewish immigrants from the Russian Empire.
The following year Benny joined the boys club band at Jane Addams's Hull House, where he received lessons from the director James Sylvester for a small cost.