1. A computer-implemented method for dynamically partition records in a data set, the method comprising: determining a resource usage threshold for processing records of the data set; determining whether the resource usage threshold has been reached in conjunction with a processing of the records using a processing range of an initial size; in response to determining that the resource usage threshold has been reached, dynamically reducing the processing range to a size less than the initial size that is based at least in part on a quantity of records expected to be processable within a resource budget; processing a first subset of the records with the processing range of the size less than the initial size; processing a second subset of the records with the processing range of the size less than the initial size; and merging results of the processing of the first subset with results of the processing of the second subset.