In addition to fine-tuning on sequence-to-sequence tasks, we have also shown that it is possible to train Chemformer simultaneously on multiple discriminative tasks. For both the molecular property prediction tasks and the biological activity prediction tasks, the Chemformer model pretrained on the combined task shows strong performance in comparison to randomly initialised and SVR baselines.