title: finding duplicated missing rows while comparing two dataframe
body: <p>I have to compare two dataframe (dmart and stg) which has same column names (a,b,c,d) -</p>
  <p>'''</p>
  <p>import pandas as pd</p>
  <pre><code>dmart = pd.DataFrame([[3,4,5,6],
                    ['oo','ew','sf','ef'],
                    [5,5,5,5],
                    [6,-6,5,9],
                    ['80', '90', '60', '70'],
                  ['10','ba','ca','da'],
                   [1, 2, 3, 5]],columns={&quot;a&quot;,&quot;b&quot;,&quot;c&quot;,&quot;d&quot;})
  
  stg = pd.DataFrame([['80', '90', '60', '70'],
                  [5,5,5,5],
                  [5,5,5,5],
                  [6,6,5,6],
                  ['1','ba','ca','da'],
                  ['80', '90', '60', '70'],
                  ['80', '90', '60', '70'],
                   [1, 2, 3, 5]],columns={&quot;a&quot;,&quot;b&quot;,&quot;c&quot;,&quot;d&quot;})
  </code></pre>
  <p>'''</p>
  <p>I have to find the all missing rows(either it is duplicated)in dmart dataframe while comparing with stg dataframe</p>
  <p>'''
  Desired Output</p>
  <pre><code>[5,5,5,5],
  [6,6,5,6],
  ['80','90','60',70'],
  ['1','ba','ca','da']
  </code></pre>
  <p>'''</p>
  <p>I am using following approach -
  (mycode) -</p>
  <p>'''</p>
  <pre><code>merge = stg.merge(dmart,how='outer', left_on=['a','b','c','d'], 
                right_on=['a','b','c','d'], 
                suffixes=('_stg', '_dmart'), indicator=True)
  
  df = merge.loc[merge['_merge'] == 'left_only']
  </code></pre>
  <p>'''</p>
  <p>My Output results -</p>
  <p>'''</p>
  <pre><code>df
  a   d   c   b   _merge
  
  6   6   5   6   left_only
  1   ba  ca  da  left_only
  </code></pre>
  <p>'''</p>
  <p>My approach is not taking the duplicate rows which are present in dmart only one time and present in stg multiple time , I want to include those rows in the output too ,</p>
  <p>Could anyone help in this ?</p>