Stein lived in Manhattan with his wife Elisa Loti, an Obie Award and Theatre World Award-winning actress who graced the cover of LIFE Magazine and who is now a psychotherapist practicing as Elisa Stein.
His son Harry Stein, unlike his father, is a political conservative and a writer known for his satirical political commentary.