title: Display of HIVE table in Spark
body: <p>I am trying to read HIVE table in Spark 1.6.1. Everything is working as per the requirement, only the display of the table in Spark is wired. The HIVE table consists of 100 mn odd records.</p>
  
  <pre><code>import os
  from pyspark import SparkContext
  sc = SparkContext("local", "Simple App")
  from pyspark.sql import HiveContext
  
  hive_context = HiveContext(sc)
  
  db= hive_context.sql("SELECT * FROM HIVE_DB.HIVE_TBL").show()
  </code></pre>
  
  <p>As you can see, I have written the query to see the entire 100 mn records.But the output is still for 20 records. My questions:</p>
  
  <ol>
  <li><p>Is that some kind of limitation with Spark 1.6.1? </p></li>
  <li><p>If yes, has the limitation been excluded in the higher Spark versions?</p></li>
  <li><p>If none of the above, then is there a way to change this configuration to see any no of records?</p></li>
  </ol>
  
  <p>I have tried below query as well::</p>
  
  <pre><code>SELECT * FROM HIVE_DB.HIVE_TBL LIMIT 200
  </code></pre>
  
  <p>Still the same display.</p>