title: Spark 2.0 memory fraction
body: <p>I am working with Spark 2.0, the job starts by sorting the input data and storing its output on HDFS. </p>
  
  <p>I was getting out of memory errors, the solution was to increase the value of "spark.shuffle.memoryFraction" from 0.2 to 0.8 and this solved the problem. But in the documentation I have found that this is a deprecated parameter. </p>
  
  <p>As I understand, it was replaced by "spark.memory.fraction". How to modify this parameter while taking into account the sort and storage on HDFS? </p>