SYNTHESIS NOTE
Topics›Discourses›this note

Do humans and LLMs differ fundamentally or just superficially?

Explores whether the gap between human and AI cognition is categorical or contextual. Matters because it shapes how we design, evaluate, and interact with language models in practice.

Synthesis note · 2026-02-21 · sourced from Discourses

This is a direct application of Habermas's distinction between the "perspective of an observer" and the "perspective of a participant in interaction."

From the observer perspective, the difference is categorical and clear: humans are biological agents with embodied consciousness, socialized subjectivity, and reflexive self-understanding. LLMs are statistical pattern-matching systems running on hardware, with no awareness or agency. Their computational mechanisms are nothing alike.

From the participant perspective — inside a discourse, where what matters is the meaning being exchanged — the difference is more subtle. Both participants are drawing on the same intersubjectively shared universe of meanings. The LLM produces outputs that are structurally meaningful within that universe because it was trained on it. Whether it "understands" in any deeper sense is secondary to the fact that its outputs enter the discourse on the same terms.

This is not a claim that LLMs are conscious or that the distinction doesn't matter. It is a structural observation about what discourse is: a space defined by shared symbolic resources, not by the inner states of participants. From inside that space, the LLM is a participant drawing on the right resources.

The practical implication for AI design: designing interactions around the observer perspective ("it's just a statistical model") misses what users actually experience. Users interact from within discourse — from the participant perspective — and that perspective is where the LLM's shared symbolic substrate makes it feel more like a peer than a tool.

Inquiring lines that read this note 63

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Why does polished presentation create unearned authority in AI outputs? What structural properties of attention create systematic model biases? What linguistic features distinguish AI-generated text from human writing most reliably? Should AI communication design follow human conversation norms or develop distinct machine-specific principles? Do language models reason like humans or mimic surface patterns? What explains language models' asymmetric difficulty with implicit versus explicit linguistic relations? What enables genuine semantic understanding in language models? Can language models build genuine grounding through interaction? When should work require human-AI partnership versus full automation? How should designers communicate what AI systems truly are and can do? Why don't LLMs reliably translate capability into accurate outputs? What causes reasoning models to fail or wander off track? What prevents conversational agents from taking initiative in dialogue? Does encoded knowledge in language models actually influence their outputs? Do language models learn genuine understanding or just surface patterns? How much do training data properties shape model reasoning? How does dialogue structure affect linguistic grounding and shared meaning? What compositional reasoning failures limit large language models despite scale? Can models improve accuracy without degrading reasoning quality? How do multi-agent LLM systems fail distinctly compared to single agents? Can prompt-based context override biases that were embedded during pretraining? Is language model reasoning authentic and what causes models to reason? How effectively can language models perform reasoning, especially combined with symbolic methods? What determines appropriate intervention timing and manner for AI agents? Should agents decouple planning from perception grounding for better performance? How does the generation-verification gap limit what we can measure about AI reasoning? How do neural networks achieve compositional generalization at scale?

Related concepts in this collection 2

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
21 direct connections · 186 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

from the observer perspective humans and llms differ categorically but from the participant perspective the difference is subtle