title: Filtering Hive partition table in pyspark
body: <p>I have a hive table which is partitioned on many countries. I want to load specific partition data to my dataframe, as shown below:</p>
  
  <pre><code>df=spark.read.orc("/apps/hive/warehouse/emp.db/partition_load_table").where('country="NCL"' &amp;&amp; 'county="RUS"')
  </code></pre>
  
  <p>It's giving me an error, though I was able to load for single partition.</p>
  
  <p>below is my directory structure in hdfs</p>
  
  <p><strong><code>/apps/hive/warehouse/emp.db/partition_load_table/country=NCL</code></strong></p>
  
  <pre><code>df=spark.read.orc("/apps/hive/warehouse/emp.db/partition_load_table").where('country="NCL"')
  </code></pre>