I finally reached this article in the September issue of Scientific American:How AI Knows Things No One Told It
I fear it is behind a paywall, but suffice to say that most has been mentioned here already. LLMs seem to build up their own model of the world, and can act as computers even though they do not have facilities for it, like e.g. memory.
The most surprising part to me was that LLMs have also developed abilities to learn without going through the learning part of their training. That is, they can learn despite having a fixed knowledge database.
The author concludes:
I fear it is behind a paywall, but suffice to say that most has been mentioned here already. LLMs seem to build up their own model of the world, and can act as computers even though they do not have facilities for it, like e.g. memory.
The most surprising part to me was that LLMs have also developed abilities to learn without going through the learning part of their training. That is, they can learn despite having a fixed knowledge database.
The author concludes:
Although LLMs have enough blind spots not to qualify as artificial general intelligence, or AGI—the term for a machine that attains the resourcefulness of animal brains—these emergent abilities suggest to some researchers that tech companies are closer to AGI than even optimists had guessed.