title: What's difference between HDInsight Hadoop cluster & HDInsight Spark cluster?
body: <p>What's difference between HDInsight Hadoop cluster &amp; HDInsight Spark cluster? I have seen that even in Hadoop cluster pyspark is available. Is the difference with respect to the cluster type? i.e. Hadoop cluster implies YARN as a cluster management layer and Spark implying Spark Standalone (or Mesos?) as a cluster management layer?</p>
  
  <p>If that is the case we can still run Spark in Hadoop cluster I believe so Spark will run on top of YARN.</p>