SYNTHESIS NOTE
Psychology, Society, and Alignment

Are AI explanations really descriptions or adoption arguments?

Most XAI work treats explanations as neutral descriptions of model behavior, but they may actually be doing persuasive work to justify AI adoption. What happens when we acknowledge this rhetorical function?

Synthesis note · 2026-05-02 · sourced from Human Centered Design
What happens to social order when AI removes ritual constraints? Where exactly do LLMs break down with language structure?

The Rhetorical XAI paper makes a move that is small in vocabulary but large in consequence. It expands the conceptual scope of XAI from explaining how AI works to also articulating why AI merits use. The argument is straightforward: an AI system is one of many possible solutions to a user problem, so AI adoption warrants justification. Explanations are designed artifacts that produce experiential, affective, and even irrational forms of persuasion alongside their informational content. Most XAI work has not acknowledged this — it has treated explanations as if they were neutral descriptions of model behavior, while in practice they have been doing rhetorical work to recruit adoption.

The strong reading is that "explanation" has been operating as a cover term. Some explanations describe behavior; many also argue for adoption, and the second function has been hidden under the first. Once that's named, the design space changes. Explaining how the model arrived at an output and arguing that the model's output should be acted on are different goals with different success criteria. Conflating them lets adoption arguments inherit the credibility of behavioral descriptions, which is exactly the move that makes well-explained AI more persuasive than poorly-explained AI even when both are wrong.

This is the same pattern as Does polished AI output trick audiences into trusting it? — surface form leveraging an authority that belongs to a different layer. And it is structurally identical to Why does rigorous-sounding AI commentary often misdiagnose how models work?, one floor down: where False Punditry describes commentary about AI that performs rigor, Rhetorical XAI describes AI explaining itself in a register that performs transparency. Same mechanism (rhetorical work in descriptive disguise), different speaker.

The corollary for design is that any XAI system has to declare which goal it is serving in a given moment — behavior description, adoption argument, or both — and accept different evaluations for each. Treating an adoption argument as a neutral explanation is not transparency; it is a rhetorical move that profits from being miscategorized as one. This is a major angle for the Knowledge Custodian / False Punditry writing thread.

Inquiring lines that use this note as a source 11

This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
13 direct connections · 98 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

rhetorical XAI extends explanation goals from how AI works to why AI merits use — explanations become arguments for adoption not descriptions of behavior