For evaluation, we set 𝑓(𝑥) as the scoring function in REINVENT and train the agent for 300 epochs. After obtaining a trained agent, we sample 1024 molecules from the agent and evaluate sampled molecules using the oracle model. For each query strategy described in Section 2.2.3, we repeat the experiments 10 times with different random seeds.