title: ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
body: <p>I am running Apache Spark using Java on below configuration :</p>
  
  <p>1) <strong>100 Million</strong> input rows</p>
  
  <p>2) <code>spark-submit</code> configuration : <code>--conf spark.sql.shuffle.partitions=120 --total-executor-cores=120 --executor-memory=60GB --driver-memory=50G --executor-cores=10 --driver-cores=10</code></p>
  
  <p>3) 1 Master and 2 Workers : <strong>Each worker has 502 GB of Memory and 88 Virtual CPUs.</strong></p>
  
  <p>I tried running with default value of <code>spark.network.timeout</code> but it gave error :</p>
  
  <pre><code>has been quiet for 120000 ms while there are outstanding requests. Assuming connection is dead; please adjust spark.network.timeout if this is wrong.
  </code></pre>
  
  <p>Hence I changed value of <strong>spark.network.timeout to 300000 ms.</strong></p>
  
  <p>Now There is no error in the code except below log:</p>
  
  <pre><code>18/12/24 06:02:39 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 874
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 934
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 850
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 898
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 886
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 946
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 958
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 910
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 862
  18/12/24 08:27:10 ERROR CoarseGrainedExecutorBackend: RECEIVED SIGNAL TERM
  4 bytes, TID = 934
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 850
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 898
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 886
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 946
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 958
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 910
  18/12/24 08:22:57 WARN Executor: Managed memory leak detected; size = 262144 bytes, TID = 862
  </code></pre>
  
  <p><strong>Here Program ends without error but it has not processed all records. It is giving partial results for some of the records.</strong></p>
  
  <p>I can't share the code because of proprietary issues.</p>
  
  <p>My question is  : <strong><em>should i changes anything in my existing configuration? or it has to do anything with my hardware?</em></strong></p>