title: RDS MySQL, Kinesis Firehose, and Elasticsearch, initial data load?
body: <p>I have a need to index data from RDS (MySQL) and S3 (documents) into Elasticsearch in order to perform fulltext searches.</p>
  
  <p>I've noted that <a href="https://aws.amazon.com/blogs/database/streaming-changes-in-a-database-with-amazon-kinesis/" rel="nofollow noreferrer">AWS Kinesis</a> seems ideal for this, and can listen to both S3 and MySQL, streaming the formatted results into Elasticsearch. </p>
  
  <p>What I don't understand, however, is how I could bulk-onboard existing data using Kinesis. </p>
  
  <p>For RDS-to-Elasticsearch I've seen the alternative of <a href="https://github.com/siddontang/go-mysql-elasticsearch" rel="nofollow noreferrer">go-mysql-elasticsearch</a> that would handle this for me, but this still leaves me stuck with gigabytes of S3 data to ingest.</p>
  
  <p>Has anybody solved this problem? I'd rather have as simple a setup as possible.</p>
  
  <p>Thanks</p>