In Fig. , we compare our AlchemBERT model against CrabNet 11 and GPTChem. GPTChem 3 is based on GPT-3, a language model with 175 billion parameters-roughly 1,000 times larger than BERT. Despite this significant difference in model size, the performance on the Matbench composition tasks does not show a substantial gap. CrabNet, 11 a manually designed model, also does not demonstrate a significant advantage over AlchemBERT.