The improvement of RL over No RL is not as large as seen in the scaffold discovery task (Figure ). This may be because there is more possibilities in discovering compounds with diverse scaffolds and relatively fa- vorable properties, compared to identifying molecules that closely resemble the input molecule while exhibiting improved properties.