Someone in the chinese room would not know anything about their in- or output. Sure you memorized that a certain set of symbols means your output should contain another set of symbols, but what do you actually “know” about these symbols.
But you have no idea what it’s about. Is it a greeting? A recipe for some pasta? Instructions to build a bomb?
Could be anything.
don’t know why you got downvoted, an LLM is essentially a chinese room, and whether such a room “knows” is still the question.
Good god it’s a hydra
don’t know why you got banned
Someone in the chinese room would not know anything about their in- or output. Sure you memorized that a certain set of symbols means your output should contain another set of symbols, but what do you actually “know” about these symbols.
But you have no idea what it’s about. Is it a greeting? A recipe for some pasta? Instructions to build a bomb? Could be anything.
no, it fucking isn’t. (see the postscript in linked article.)
Thanks for that read.