• reward r = score(x j )score(x i ) for any transition from molecule x i → x j • C, the discovered set contains all explored molecules that satisfy Equation , where the threshold is given by the input parameter δ • We terminate an episode when the number of steps exceeds 10.