Critical Phase Transition in Large Language Models
natural language processing;large language models;statistical physics;phase transitions;critical phenomena;large-scale numerical experiments
Yes
No ethics review needed.
* In the introduction, the motivation that “the decay of correlation in natural languages follows a power law” is used. This is an incredibly vague statement. What are some concrete correlations in natural language that this applies to?
* Terminological clarifications: 
    * What are “changes with a singularity”, both in a physics and POS sequence context?
    * What is a concrete example of a ‘critical phenomenon’ in a physical system and what might be an example of one in natural language? 
    * What does it mean that “the high-temperature phase is not simply disordered”? What does this look like qualitatively in language? Does it tell us something about human-generated natural language? And what does it mean about a language model?
* What are the implications of causality being broken for the conclusions that can be drawn? It seems as though this might invalidate results. I don’t see why the effect “shouldn’t matter”. I also don’t think it’s accurate to use the example of next characters as a situation where there are not dependency relationships. Anecdotally: language modeling can also be successful at the character-level. Perhaps I am not understanding something.
* The motivation behind the paper is nice: the application of a well-studied concept from physics can perhaps allow us to use knowledge about/properties of that concept to better understand natural language and language models
* The work provides a comparison of quantitative aspects of human- and machine-generated language, an approach that is more objective than the qualitative comparisons that are often done and thus perhaps a better ground from which to draw conclusions 
* The finding that the statistical properties of language at different sampling temperatures is interesting (anecdotally, at least)
This paper proposes that qualitative changes in language model outputs can be analyzed as phase transitions—an analogy drawn from statistical physics. The authors empirically explore the shifts in characteristics of model-generated natural language that appear with sampling temperature scaling, which they posit may resemble phase transitions observed in physical systems. They observe a shift from what they characterize as an ordered to a disordered phases (i.e., the temporal structures in the different sets of sequences are statistically distinctive) as a result of changes in temperature. They conclude that LMs exhibit phase transition-like behavior around critical parameter values. They compare several quantitive attributes of the sequences generated at different temperatures to those of human generated text and find notable differences.
* The paper is generally difficult to follow:
    * There is confusing terminology that isnt defined/contextualized before it is used, e.g., “long-range correlation” in the introduction). This will likely confuse most readers (myself included)
    * The implications of the observed critical properties are incredibly unclear. See subsequent questions for the parts that felt particularly unclear to me, although this is not comprehensive. As such, it is difficult to draw meaningful conclusions from the paper
* The work only looks at changes in model behavior as a result of changing the temperature parameter. This is a very narrow exploration and also somewhat contrived since it's an external change to the model that doesn’t have any implications about what happens when internal model attributes vary
* Only rather small models are used (on the scale of 100M parameters) and so results are not relevant for modern LLMs
Yes
No ethics review needed.
- Can you help me interpret Equation (1)? My understanding is that $a$ and $b$ are POS tags, and $y_t$ is the particular POS tag at position $t$. Therefore, this is measuring whether there is a predictable relationship that when $y_t=a$, then $y_{t+\\Delta t}=b$. What is the purpose of the second term? Does it serve as some kind of normalization, to account for the base frequency of $y_t=a$ and $y_{t+\\Delta t}=b$? Why are there $18 \\times 17/2$ possible pairs $a$ and $b$? I would have assumed $18^2$?
- L. 240: "The plateau value increases with the position $t$ of the former tag." Is this true? It looks like the green line ($t=15$) is ordered between purple ($t=0$) and blue ($t=3$).
- L. 244: What is "the prefactor" of the decay? I am again failing to see a reliable trend for $t$, since it seems like $t=0$, $t=63$, and $t=225$ all have extreme error bars, while $t=3$ and $t=15$ do not.
- L. 301: What does it mean for a spectrum to be featureless?
- For the power spectra analysis, I can see how the plots at different temperatures look different, but why is there *singular* behavior at $T=1.0$?
- In Figure 5, doesn't $v(t)$ immediately reach its limiting value for $T=1.0$, contrary to what's written in the paper?
This paper investigates whether LLMs go through phase transition with the temperature parameter. This (I believe) contrasts with much of the literature, which is about the possibility of a phase transition with the size of the model. The statistics that the authors introduce may have value for future work that aims to study structural features of LLM generations.

The writing and organization are clear, and the figures are clearly explained.
This paper argues that LM generations undergo a phase transition at temperature $T = 1$. Specifically, they generate texts from GPT-2 using different temperatures (conditioned on only the BOS token), and map each text into a sequence of POS tags (though the focus only on PROPN), and study three features of the POS tags.

1. **Correlation between two tags:** The authors study whether PROPN tags are correlated at particular intervals in the text. They find the integrated correlation $\\tau$ between PROPN and PROPN saturates to a finite value for $T>1.0$, which means correlation decays faster than critical decay, whereas for $T<1.0$, $\\tau$ diverges, which means the correlation converges to a finite value. In other words, sequences with $T<1$ have long-range correlation between POS tags, and sequences above $T>1$ converge to zero correlation.
2. **Power spectra of POS sequences**: The authors study whether there is periodic appearance of the PROPN tag via the power spectrum. Again, there appears to be long-range order at $T<1.0$, but at $T>1.0$ the spectrum is featureless.
3. **Time evolution of POS sequences:** The authors study the probability of the PROPN tag at time $t$. They find that this probability converges quickly to a limiting value for $T<1.0$ and $T>1.0$, but converges much more slowly for values close to $T\approx 1.0$.
- There are obvious empirical concerns: namely, in the main paper, the authors only study GPT-2 small, and all of the analysis is specifically about the structure of where the proper noun PROPN tag occurs in generated text. This must be quite narrow, and it would be more convincing if the authors could summarize the results for other models and other POS tags in the main paper (they are referenced as being in the Appendix, which I did not read).
- This is very far from my area of expertise, but I am not convinced that there is truly *singularity* at $T=1.0$. In their analysis in §4.2 (power spectra) and §4.3 (time evolution), the model seems to demonstrate continuous behavior around $T=1.0$. In particular, I am looking at Figure 3 (A), where the peak in integrated correlation actually occurs at $T=1.1$, and Figure 5, where the values neighboring $T=1.0$ (from $0.9$ to $1.2$) all behave qualitatively similarly to $T=1.0$. This makes me worried that the paper is just showing that generations have structurally different qualities for small $T$ and large $T$, which is somewhat obviously true because $T$ directly controls the peakiness of the LM prediction, such that low $T$ will be highly redundant and high $T$ will be quite degenerate (esp. for GPT-2 era models).
- It is not clear to me how important the authors' findings are for the community. They mention their results suggest "a meaningful analogy between LLMs and natural phenomena," but the analogy was not clear to me from reading the paper. Are there practical insights about what LMs are learning or how we should build future LMs?
- There seems to be [related work](https://community.wolfram.com/groups/-/m/t/2958851) from 2023 that also studies phase transition at $T=1.0$, which the authors mention, and the distinction in their contributions is not clear to me. This may lessen the novelty of their work.
Yes
No ethics review needed.
1. In what ways will the understanding of phase transition impact future LLM works?
1. The project fosters the understanding of LLMs from an interesting angle of phase transition.
2. The experiments are well designed and cleared documented.
This paper investigates whether phase transitions occur in Large Language Models (LLMs). The authors conduct a statistical analysis of sequences generated by GPT-2 at various temperatures and found the phase transition occurs.
1. While LLMs develop fast over the past few years, this work tests on GPT-2, instead of newer generations of models.
Yes
No ethics review needed.
1. What is the motivation behind the POS tag correlation on p. 5? It's not necessarily intuitive why a proper noun appearing at time t should be highly correlated with a proper noun appearing at time $t+\Delta t$ for large $\Delta t$ (e.g. 100 tokens later; Figure 2). What do these correlations tell us about the actual text that gets generated?
2. Consider including the word temperature in the title; phase changes often refer to transitions over the course of pretraining (https://arxiv.org/abs/2209.11895) rather than varying the temperature parameter, so it would be helpful to clarify that this paper focuses on varying temperature.
1. Drawing a connection between statistical physics and LLM text generation is very interesting.
2. The paper identifies a phase transition for multiple metrics (correlation between two tags, power spectra).
This paper identifies a phase transition around temperature 1.0 when increasing the temperature parameter for LLM text generation. They focus on POS tags of generated sequences, finding a phase change in (1) the correlation of POS tags at two time points (for some time change $\Delta t$) and (2) periodic behavior. Natural text seems to correspond to roughly temperature 1.0.
1. The results for periodic behavior are nicely quantified, but slightly unsurprising (degeneration into repeated sequences for low temperature, but not high temperature; e.g. https://arxiv.org/pdf/1904.09751). Looking at the specific types of repetitive loops that the model falls into could be more informative.
2. The result that GPT-2 is closest to natural language text at T=1.0 is a bit unsurprising given that this leaves the probabilities unchanged from how they were trained. For example, we would likely expect lowest perplexity over a large corpus for T=1.0, because the model is trained to minimize loss (log-perplexity) for T=1.0.
We have discovered a temperature-induced phase transition in LLMs, with its critical properties similar to those of natural language.
@inproceedings{
anonymous2024critical,
title={Critical Phase Transition in Large Language Models},
author={Anonymous},
booktitle={Submitted to The Thirteenth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=pf9J3GNxSe},
note={under review}
}
Large Language Models (LLMs) have demonstrated impressive performance. To understand their behaviors, we need to consider the fact that LLMs sometimes show qualitative changes. The natural world also presents such changes called phase transitions, which are defined by singular, divergent statistical quantities. Therefore, an intriguing question is whether qualitative changes in LLMs are phase transitions. In this work, we have conducted extensive analysis on texts generated by LLMs and suggested that a phase transition occurs in LLMs when varying the temperature parameter. Specifically, statistical quantities have divergent properties just at the point between the low-temperature regime, where LLMs generate sentences with clear repetitive structures, and the high-temperature regime, where generated sentences are often incomprehensible. In addition, critical behaviors near the phase transition point, such as a power-law decay of correlation and slow convergence toward the stationary state, are similar to those in natural languages. Our results suggest a meaningful analogy between LLMs and natural phenomena.
I certify that there is no URL (e.g., github page) that could be used to find authors’ identity.
I acknowledge that I and all co-authors of this work have read and commit to adhering to the ICLR Code of Ethics.
natural language processing large language models statistical physics phase transitions critical phenomena large-scale numerical experiments
I certify that there is no acknowledgement section in this submission for double blind review.
/pdf/e75ac651560db909249c3fc3effce4ac291fa3b1.pdf
foundation or frontier models, including LLMs
I understand the reciprocal reviewing requirement as described on https://iclr.cc/Conferences/2025/CallForPapers. If none of the authors are registered as a reviewer, it may result in a desk rejection at the discretion of the program chairs. To request an exception, please complete this form at https://forms.gle/Huojr6VjkFxiQsUp6.
I certify that this submission complies with the submission instructions as described on https://iclr.cc/Conferences/2025/AuthorGuide.
/attachment/85165e110576e233e6061023b9ed26813421a6d0.zip
Critical Phase Transition in Large Language Models
ICLR 2025 Conference Submission
ICLR.cc/2025/Conference/Submission