title: Spark: How to start remotely Jupyter in 'yarn_client' mode from a different user
body: <p>Let's assume I've got a 4 nodes Hadoop cluster (Cloudera distro in my case) with a user named 'hadoop' on each node ('/home/hadoop'). Also, I've got a fifth server with installed on it, Jupyter and Anaconda with a user named 'ipython', but without hadoop installation.</p>
  
  <p>Let's say I want to start Jupyter remotely from that fifth server in 'yarn_client' mode by keeping the 'ipython' user, my problem is that I've got an issue from logs which says that the user 'ipython' isn't allowed (or something like that).</p>
  
  <p>For info I copied-paste a dummy directory (to set the HADOOP_CONF_DIR environment variable) from the Hadoop cluster to that fifth server. Everything works well with the 'local[*]' setting in my 'kernel.json' file (fortunately), but the issue appears back when I change the master value into 'yarn_client' (unfortunately)...</p>
  
  <p>Is there a trick to solve that issue ? Or maybe several different tricks ?</p>