Figure (a) presents heatmaps of cosine similarities for 128 randomly selected pairs of crystal structures and their textual descriptions which are reduced compositions of the crystal structures. The results for different types of textual descriptions are provided in Supplementary Information S1-2. Within the heatmap, the diagonal elements, which represent positive pairs, show high cosine similarity, approaching 1. In contrast, the off-diagonal elements, representing negative pairs, display significantly lower cosine similarity, approaching -1. On the other hand, the baseline BERT model fails to distinguish between positive and negative pairs, highlighting the utility of contrastive learning in Crystal CLIP.