That “intelligence” will tell you how it is not as intelligent if you ask directly. This is not because it’s intelligent and KNOWS it’s limitations but because it picked up on my signal for what I wanted and gave something resembling that to me. You could ask it the opposite thing and arrive at a very different conclusion.
https://claude.ai/share/97859aae-beb2-4245-a8b1-460122ee4aa1
I would even say the analogies it gave aren’t entirely accurate. A person reading a book experiences it very differently than an LLM. And this is a key insight to an element of the Turing test where you ask it to explain some poetry (not simply write a poem).
I still don’t understand how it cannot be as intelligent as us.
That “intelligence” will tell you how it is not as intelligent if you ask directly. This is not because it’s intelligent and KNOWS it’s limitations but because it picked up on my signal for what I wanted and gave something resembling that to me. You could ask it the opposite thing and arrive at a very different conclusion. https://claude.ai/share/97859aae-beb2-4245-a8b1-460122ee4aa1
I would even say the analogies it gave aren’t entirely accurate. A person reading a book experiences it very differently than an LLM. And this is a key insight to an element of the Turing test where you ask it to explain some poetry (not simply write a poem).
While I agree that it doesn’t have a physical experience, I don’t think a physical experience is necessary to speak to someone.