Here, we report on our OpenFF Evaluator framework, which was designed to overcome these issues. In particular, it is an automated, scalable, Python framework for the curation of physical property data sets from open data sources, and the estimation of properties of such data sets using a combination of molecule simulation and cached molecular simulation data.