title: _corrupt_record error when reading a JSON file into Spark
body: <p>I've got this JSON file</p>
  <pre><code>{
      &quot;a&quot;: 1, 
      &quot;b&quot;: 2
  }
  </code></pre>
  <p>which has been obtained with Python json.dump method.
  Now, I want to read this file into a DataFrame in Spark, using pyspark. Following documentation, I'm doing this</p>
  <blockquote>
  <p>sc = SparkContext()</p>
  <p>sqlc = SQLContext(sc)</p>
  <p>df = sqlc.read.json('my_file.json')</p>
  <p>print df.show()</p>
  </blockquote>
  <p>The print statement spits out this though:</p>
  <pre><code>+---------------+
  |_corrupt_record|
  +---------------+
  |              {|
  |       &quot;a&quot;: 1, |
  |         &quot;b&quot;: 2|
  |              }|
  +---------------+
  </code></pre>
  <p>Anyone knows what's going on and why it is not interpreting the file correctly?</p>