title: Disadvantages of Spark Dataset over DataFrame
body: <p>I know the advantages of <code>Dataset</code> (type safety etc), but i can't find any documentation related <strong>Spark Datasets Limitations</strong>.</p>
  
  <p>Are there any specific scenarios where Spark <code>Dataset</code> is <strong>not recommended</strong> and better to use <code>DataFrame</code>.</p>
  
  <p>Currently all our data engineering flows are using Spark (Scala)<code>DataFrame</code>. 
  We would like to make use of <code>Dataset</code>, for all our new flows. So knowing all the limitations/disadvantages of <code>Dataset</code> would help us.</p>
  
  <p><strong>EDIT:</strong> This is not similar to <a href="https://stackoverflow.com/questions/40596638/spark-2-0-dataset-vs-dataframe">Spark 2.0 Dataset vs DataFrame</a>, which explains some operations on Dataframe/Dataset. or other questions, which most of them explains the differences between rdd, dataframe and dataset and how they evolved. This is targeted to know, <strong>when NOT to use Datasets</strong></p>