1. A method implemented at least in part by a computer, the method comprising: discovering one or more target data sources from which to obtain data; generating a data structure that indicates a plurality of chunks of the data to obtain from the one or more target data sources; generating a plurality of queries from a template, the plurality of queries including values derived from the data structure to indicate the plurality of respective chunks of the data; submitting a first query of the plurality of queries to one or more of the one or more target data sources; receiving a response to the first query, the response including a respective chunk of the plurality of chunks; storing the chunk in a local data store; determining a plurality of periods to wait, each period corresponding to a respective query of the plurality of queries, the determining comprising: obtaining a formula from configuration data and using the formula to compute at least one of the plurality of periods; in response to the first query completing, waiting until the period that corresponds to the first query expires to submit another query of the plurality of queries, the waiting comprising: enabling one or more other queries that are not included in the plurality of queries to be processed; and performing the following operations for each subsequent query of the plurality of queries until the plurality of chunks is obtained: after the period that corresponds to the previous query has expired, submitting the query to obtain a respective chunk of the data from the one or more target data sources; receiving a response to the query, the response including a respective chunk of the plurality of chunks; storing the chunk in the local data store; and in response to the query completing, waiting until the period that corresponds to the query expires to submit another query of the plurality of queries, the waiting comprising: enabling one or more other queries that are not included in the plurality of queries to be processed, each period of the plurality of periods being determined prior to waiting until the respective period expires.