title: amazon emr jupyterhub and spark cluster; notebook has no autocomplete
body: <p>The pyspark3, pyspark, and spark kearnels in jupyterhub docker on amazon emr do not seem to allow autocomplete of function names or the doc string , shift-tab.  Has anyone else noticed this behaviour?</p>
  
  <p>I launched a cluster with jupyterhub and spark.
  I created a new notebook for pyspark or pyspark3.  </p>
  
  <p>It seems to be using conda inside the docker.  I have tried to upgrade all but that just breaks everything.</p>