title: ETL batch processing
body: <p>I'm looking for some open source technology that will allow me to create scheduled batch processing (e.g. Query every 1 hour some SQL DB like Oracle, and insert to Kafka. It is possible that some transformation will be done to the data between). The thing is that I need to be able to transport large amount of data ("big data" - Oracle queries could return 10GB or more).</p>
  
  <p>I read about Apache Airflow for example, but it does not seem to fit for large amount of data.</p>
  
  <p>What other technologies can I use for that purpose?</p>