Some good analysis by Ben Goertzel here:

LLMs extrapolate "a fairly small distance from a rather large volume of information."

What we need is "the ability to sometimes effectively cognitively leap a much longer distance from a teeny amount of information."