Horowitz was born in New York City on September 25, 1929, to Louis and Esther Tepper Horowitz.
In 1951, he married Ruth Narowlansky, with whom he had two children, Carl and David; they were divorced in 1964.