Our experiments and the conclusions drawn from these are limited by the design choices we made. We used the LSTM and GA molecular optimizers as they performed well in GuacaMol . It may however be the case that other algorithms do not exhibit the same deficient behaviour shown above. We chose ECFP fingerprints as they have been shown to often perform well . Random Forest classifiers were chosen as they can be trained relatively robustly and also have acceptable performance.