To increase optimization power, the easiest proposal is to increase the score contribution to the augmented likelihood used by REINVENT by increasing the scalar value σ. The original work had a default value of 60, however, the subsequent update (REINVENT 2.0 ) increased this value to 120 -suggesting that sample-efficiency was sub-optimal. Therefore, we first varied the value of σ between 30 and 240 and updated an agent for 100 RL steps only (6,400 samples), to minimize computational expense. However, as shown in Figure , we found little improvement in optimization of DRD2 docking scores using this approach with REINVENT. The maximum docking score optimization achieved (best mean score relative prior mean score) was 128% with σ=60 or 127% with σ=240, concluding that changing σ values alone did not significantly improve optimization over limited RL updates.