Discover novel molecules and expand the frontier. Our method explores the chemical space with a property-aware and novelty/diversity-aware reinforcement learning policy that proposes addition/deletion modifications to the molecular state at every environment step to optimize for the reward r. We gradually expand the discovered set C by adding qualified molecules found in the RL exploration within the MDP. A molecule x is qualified if: x satisfies the desired properties measured by property scores