The goal is to evaluate whether RL could help steer the transformer-based generative model towards a desirable chemical-and physical-property space. Therefore, the transformer models trained on molecular pairs but without RL serve as baselines. For the main experiments, we use our most recent transformer model which is trained on the PubChem database. For RL, different REINVENT configurations are used, see Table .