title: Databricks - CSV not loading properly
body: <p>I have a simple csv file that's pipe delimited that I can load into Databricks, then disuplay the df and it displays nicely. I then try with my main dataset which is formatted the same way and an export from SQL server. After it loads the output shows that it was loaded (lists the field names and the data type it inferred -- all string though which isn't a good sign)</p>
  
  <pre><code>df = spark.read.format("csv").options(header='true', quote='"', delimiter="|",ignoreLeadingWhiteSpace='true',inferSchema='true').load("/mnt/gl/mainfile.csv")
  </code></pre>
  
  <p>Then I do display (df) and I don't see a nice display. Instead it shows the following:</p>
  
  <pre><code>Job 34 View
  
  (Stages: 1/1)
  
  Job 35 View
  
  (Stages: 1/1)
  
  Job 36 View
  
  (Stages: 1/1)
  </code></pre>
  
  <p>Obviously the csv is at fault here but I've no idea how to go about solving this - I've already been careful with how I export it from SQL server so not sure what I'd do differently there.</p>