title: Troubleshooting Spark cluster shutdown
body: <p>I'm new to Spark &amp; AWS. We have a shutdown procedure for our Spark clusters. However, it's not gracefully shutting down. It gets stuck for some reason. Right now, we're using Splunk to log our shutdown procedure, however, Splunk has a 4 hour delay so this logging isn't helpful. Are there alternatives to easily trouble shoot this? Thanks in advance!</p>