One major concern with RL methods in the real-world is sample efficiency , i.e. the number of oracle calls needed to reliably learn the desired output. While REINVENT has been found to be among the most sample-efficient generative chemical models , it still typically requires thousands of oracle evaluations to learn to produce favorable molecules.