For molecules, we investigated properties ranging from HOMO-LUMO gaps and solubility in water to the performance in organic photovoltaics. For materials, we focused on the properties of alloys, metal-organic frameworks, and polymers. Finally, for reactions, we considered two key cross-coupling reactions in organic chemistry. Extended Data Tab. 2 shows that in the low data regime, our GPT-3 model is typically at least as good as the conventional ML model and often needs fewer data. In the high-data regime, the conventional ML models often catch up with the GPT-3 model. This makes sense as for a given size of the data set, the need for additional data and correlations (inductive biases) captured by GPT-3 might be less needed.