• Employing the REINVENT framework, we utilized reinforcement learning to sample the neighborhood of a compound. Tanimoto similarity calculated with ECFP4 fingerprints with counts was used as the scoring function. Our reinforcement learning process involved 300 steps, with the sampling of 100 compounds at each step, resulting in a total of 30,000 compounds for each of the TTD molecules.