title: How to compare 2 dataframes in PySpark based on 2 columns?
body: <p>In PySpark I'm trying to compare 2 dataframes which a common columns. Tha dataframes looks like this:</p>
  
  <pre><code>df1   ...   ...
  aa1   ...   ...
  bb2   ...   ...
  ab3   ...   ...
  cc4   ...   ...
  
  df2   ...   ...
  a1    ...   ...
  b3    ...   ...
  </code></pre>
  
  <p>The idea is to check if df1 contains rows with the substring of df2. If so, get those rows. The result from above would be then:</p>
  
  <pre><code>result
  aa1
  ab3
  </code></pre>
  
  <p>Or in pseudocode:</p>
  
  <pre><code>df1.filter(df1.col.likes(df2.col))
  </code></pre>
  
  <p>Thanks in advance!</p>