title: Pyspark has different versions in driver (python3.5) and worker(python2.7)
body: <p>I am using both hdfs and normal user mode.Default Python version in local is 3.5 and in hdfs is 2.7.This error popped up when I was trying to load files in hdfs and trying to display it in jupyter. </p>
  
  <p><a href="https://i.stack.imgur.com/GtG32.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/GtG32.png" alt="enter image description here"></a></p>
  
  <p>I tried to edit the spark-env.sh file.But when I looked for it there are multple spark -env.sh files and I edited all of them but in vain.I found similar questions in stack overflow, but nothing seems to work and suit my particluar problem.</p>
  
  <p><strong>If you require information on anything, please let me know in the comments, as I dont know what kind of information is required here.</strong></p>