title: Why does Spark job fail with "too many open files"?
body: <p>I get "too many open files" during the shuffle phase of my Spark job.  Why is my job opening so many files? What steps can I take to try to make my job succeed.</p>