title: deduplicate messages whil reading from kafka
body: <p>Kafka log compaction is not working for me.
  I used the following code to create the topic : </p>
  
  <pre><code>bin/kafka-topics.sh --create --zookeeper z-3.gfxiq-dev-totalflex-rd.6b5t67.c4.kafka.eu-west-3.amazonaws.com:2181,z-1.gfxiq-dev-totalflex-rd.6b5t67.c4.kafka.eu-west-3.amazonaws.com:2181,z-2.gfxiq-dev-totalflex-rd.6b5t67.c4.kafka.eu-west-3.amazonaws.com:2181  --topic  finals  --replication-factor 1  --partitions 1   --config cleanup.policy=compact   --config min.cleanable.dirty.ratio=0.001  --config segment.ms=5000
  </code></pre>
  
  <p>It keeps reading the records having the same key. </p>