anchor.diff: -= Streaming data to a downstream Elasticsearch
  += Streaming Data Changes from Your Database to Elasticsearch
   jpechane
   :awestruct-tags: [ mysql, postgres, elasticsearch, smt, example ]
   :awestruct-layout: blog-post
   
  -We have seen how to stream a change data changes to a downstream database link:/blog/2017/09/25/streaming-to-another-database[few weeks ago].
  -
  -In this blog post we will follow the same approach to stream the data to an https://www.elastic.co/[Elasticsearch] server for potential further search processing. But to make the matter a little bit more interesting we will stream the data to both PostgreSQL database and Elasticsearch so we will optimize access to data both via SQL query language and a full-text search.
  +We have seen how to set up a change data stream to a downstream database link:/blog/2017/09/25/streaming-to-another-database[few weeks ago].
  +
  +In this blog post we will follow the same approach to stream the data to an https://www.elastic.co/[Elasticsearch] server for potential further search processing. But to make the matter a little bit more interesting, we will stream the data to both, a PostgreSQL database and Elasticsearch, so we will optimize access to the data via the SQL query language as well as via full-text search.
   
   == Topology
  -The general topology for this scenario is displayed on the following picture:
  +The general topology for this scenario is shown in the following picture:
   
   .A General topology
   [#img-general]
  
positive.code: 
  &nbsp; +
  
  We are going to simplify the deployment again, so we will use only one Kafka Connect instance that will contain all connectors and will serve as both an event producer and consumer.
  
  &nbsp; +
  
  
negative.code: 
  == Summary
  
  We set up a complex streaming data pipeline to synchronize a MySQL database with another database and also with an Elasticsearch instance.
  We managed to keep the same identifier across all systems which allows us to correlate records across the system as the whole.
  If you'd like to try out this set-up yourself, just clone the project from our https://github.com/debezium/debezium-examples/tree/master/unwrap-smt[examples repo].
  In case you need help, have feature requests or would like to share your experiences with this pipeline, please let us know in the comments below.
  
  == About Debezium
  
  