From Table we can see that transfer learning provides a significant improvement; pre-trained models beat the randomly initialised baseline for all datasets. We can also see that the Chemformer model pre-trained on the combined task is the strongest performer. Other than molecular optimisation, the combined model performs best on all tasks. For molecular optimisation, the model pre-trained using only masking is the best performer, while the combined model is unable to beat the model with no pre-training. We discuss possible explanations for this in more detail in Section 4.