The question about what sort of "cognition" is going on in the simulated neural network of the current LLMs is an open one.

Saying "it's not intelligence" it's the wrong framing.

also, there are fully open LLM, including the training data.

He was right on a number of things, very important ones, but he's loosing it with old age, as we all will.