In this work, we lay out how this framework can be used to optimize force fields, and discovered that for parameter optimization of simple physical properties of liquids such as densities and heats of vaporization, reweighting using cached data from previous iterations of optimization may not be efficient compared to direct physical simulation. We thank the Open Force Field Consortium and Initiative for scientific and financial support, and Molecular Sciences Software Institute (MolSSI) for its support of the Open Force Field Initiative. We also thank David Slochower (ORCID: 0000-0003-3928-5050) and Jeff Wagner (ORCID: 0000-0001-6448-0873) for useful discussions on the API of the framework and Josh Fass (ORCID: 0000-0003-3719-266X) and Owen Madin (ORCID: 0000-0002-6736-3442) for useful discussions on reweighting and gradient calculations.