Does language understanding happen only in the language system?
Explores whether the brain's core language system alone can produce genuine understanding, or whether deep comprehension requires dispatching information to perception, motor, and memory regions.
"What Does It Mean to Understand Language?" (2025, arXiv:2511.19757) proposes that language understanding entails not just extracting surface-level meaning but constructing rich mental models of the situation described. Critically, the brain's core language system is fundamentally limited in what it can compute — deep understanding requires exporting information from the language system to other brain regions that handle perceptual and motor representations, construct mental models, and store world knowledge and autobiographical memories.
This has direct implications for the LLM grounding debate. If even human brains cannot understand language within the language system alone — if understanding requires routing to non-linguistic systems — then the architectural question for LLMs is not whether they have "enough language" but whether they have the non-linguistic systems to route to. Current transformer architectures are, in this framing, all language system with no export targets.
This provides neuroscientific grounding for claims in Are language models developing real functional competence or just formal competence? — formal competence lives within the language system, while functional competence requires the export pathways this paper describes. It also strengthens What makes linguistic agency impossible for language models? by showing the embodiment requirement is not just philosophical but neuroanatomical.
The "export" framing is more precise than the usual "embodiment" argument because it specifies what must be exported (situation models, perceptual simulations, motor plans) and where (domain-specific brain regions), making it potentially testable against multimodal AI architectures that integrate vision, action, and memory alongside language.
Inquiring lines that use this note as a source 4
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
- Are potemkin understanding and split-brain syndrome describing the same phenomenon?
- What distinguishes genuine understanding from correct output without coherent principles?
- Can understanding language happen entirely within a language system alone?
- Can the human mind be uploaded or only its context?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- What does it mean to understand language?
- Mechanistic Indicators of Understanding in Large Language Models
- Word Meanings in Transformer Language Models
- Dissociating language and thought in large language models
- Training Large Language Models to Reason in a Continuous Latent Space
- Probing Structured Semantics Understanding and Generation of Language Models via Question Answering
- Computational structuralism: Toward a formal theory of meaning in the age of digital intelligence
- Comprehension Without Competence: Architectural Limits of LLMs in Symbolic Computation and Reasoning
Original note title
deep language understanding requires exporting information from the core language system to perceptual motor and memory systems