title: Pentaho: combination lookup/update does not process all rows in the source
body: <p>I am using Pentaho Data Integration to do a SCD type 1 transformation. I am using combination lookup/update transform to generate the surrogate key value (upon insert). The commit size is 100000 and the cache size is 99999. My source table has 19763 rows and when I run the job to load data into the destination (dimension table), the combination lookup/update just processes 10000/19763 rows every single time.</p>
  
  <p>How can I get it to process all the records (19763<a href="https://i.stack.imgur.com/6SEXH.jpg" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/6SEXH.jpg" alt="enter image description here"></a>) in the source table ????</p>