title: Elasticsearch client for retrieving large datasets
body: <p>I am evaluating right technologies which fits for retrieving large volume of records (in millions) with some filter and aggregation requirements. I am consider some of the below technologies -</p>
  <ul>
  <li>Elasticsearch client for python</li>
  <li>run spark job using pyspark\scala spark</li>
  <li>Elastic search query DSL</li>
  </ul>
  <p>While i did some hands on around first option (elastic search client for python) i see that it has a limit of retrieving only 10000 records in 1 call and require additional scrolling or pagination type of implementation.</p>
  <p>While writing this i am going to start with second option. I would like to hear from ELK experts here, if there is any recommended technologies to meet this use case (Retrieving large records from elastic search using some filters and aggregation clauses. It might help me to think more then out of my box.</p>
  <p>Thanks for your time and inputs in advance.</p>