We call this protocol parallel replica simulations (PRS). By employing the PRS, we are able to scatter the memory usage in different computing nodes while obtaining more reliable gradients. Initially, we equilibrated, letting the system evolve without tracing any operation. ), which is the quantity effectively minimized. In the zoomed-in part at the top right, a single lipid optimization unit -PRS -which is composed of independent parallel simulations containing an equilibration followed by differentiable sampling. Each PRS unit produces a loss function defined by Equation . On the bottom right, comparison between the losses obtained from training a single DPPC membrane, with and without replicas.