The deflationary account would be that he considers extensive cognitive architecture (CoT, external memory, vector storage, etc) around a base LLM "not primarily using LLMs", but we must wait for the actual paper.