We evaluated three architectures -GPT2, Mistral 7B , and CodeT5 Small 27 -on three tasks: forward reaction prediction, retrosynthesis, and property prediction. For GPT2, we further varied the model size, GPT2 Small, GPT2 Medium (M), GPT2 Large (L), and GPT2 XL, to examine the impact of scaling. Additionally, we compared performance using two training data sizes: 80k and 1M data points.