Some researchers claim that LLMs have learned a rudimentary model of the world. For example, in this paper, the authors show that LLMs during training form spatial (and temporal) word models and that these can then be extracted and studied [11].