Far from being “stochastic parrots,” the biggest large language models seem to learn enough skills to understand the words they’re processing.

Since it’s been a controversy on here a couple times, here’s a great example of how you can demonstrate an LLM can produce something it can’t have seen before.

It doesn’t prove anything beyond doubt, but I think these kinds of experiments show to something like a civil law standard that they’re not merely parrots.