Why do LLMs produce such different writing in chat versus posts?
Explores whether the shift from deferential conversation to confident declarations reflects distinct generation modes or stylistic variation, and what training conditions produce this split.
The same model that responds to a chat prompt with "great question — let me clarify what you're asking" will, given a "write a LinkedIn post on X" prompt, produce confident impersonal prose that takes no questions and offers no hedging. The two registers come from one weight set, which means the difference is conditioned by prompt context and by the post-training distribution of expected output for each context. It is not an artifact of distinct models or distinct subsystems.
The chat register is shaped by RLHF on conversational data, which rewards friendliness, helpfulness, deference to the user's framing, and acknowledgment of uncertainty. The post register is shaped by training on published prose, which is impersonal, declarative, and stance-bearing in a way that suppresses uncertainty markers. When the prompt asks for a post, the model conditions on the post distribution; when the prompt invites conversation, it conditions on the conversational distribution. Both modes are sincere outputs of the same system and both miss the relevant property of human discourse — chat misses by being too deferential to converge on a real position, posts miss by being too declarative to seek any real interlocutor.
The implication for analysis is that "AI writing" cannot be characterized in the singular. Critiques of AI sycophancy and critiques of AI false objectivity are critiques of the same model in two registers. Each register inherits the failure mode of its training distribution. The chat register cannot stake a position because its training rewards do not select for stake-taking. The post register cannot solicit reply because its training distribution did not contain the soliciting-of-reply as a property of published prose.
This explains why Does AI content displace human influencers on social media? specifically targets the post register: it is the published-prose mode that displaces published-prose practitioners, while the chat mode operates in private and does not enter the same economy.
Inquiring lines that use this note as a source 21
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
- What traces of production normally mark expert discourse?
- Why do comprehensive posts without uncertainty tend to suppress conversation?
- Does chat-mode deference prevent LLMs from actually taking meaningful positions?
- Why do published prose training data omit solicitation as a discourse property?
- How does conversational format activate System 1 acceptance in users?
- Why do LLM regenerations produce meaningfully different personalities from the same prompt?
- What constrains LLM generation beyond default politeness in review contexts?
- Why do moderators show vastly different confidence across conversation types and contexts?
- How does monological training on text differ from dialogical training in conversation?
- How does perceived gatekeeping differ between Wikipedia and ChatGPT?
- How does prompting language shift what LLMs express about political figures?
- Can knowledge density explain why LLM writing feels coherent but fatiguing?
- What's the difference between language generation and human-to-human communication?
- How does the absence of evaluative stance appear in LLM academic writing?
- What causes different personality traits to trigger different emoji densities in generated text?
- Can LLMs distinguish stylistic patterns that carry meaning from mere convention?
- Do LLMs address the prompter but persuade the public differently?
- Is the distinction between pretense and realization meaningful for LLMs?
- Why do LLMs mirror stylistic features of posts they reply to?
- What role does stylistic convergence play in LLM persuasion effectiveness?
- Do LLMs mirror the style of text they are prompted to respond to?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does AI content displace human influencers on social media?
Explores whether AI-generated posts that circulate without an identifiable author undermine social media's reputation-building function and crowd out human creators competing for attention.
the post-register failure has the systemic displacement consequence
-
Does user satisfaction actually measure cognitive understanding?
Users may report satisfaction while remaining internally confused about their needs. This explores whether traditional satisfaction metrics capture genuine clarity or merely social politeness.
the chat-register optimization target
-
Does polished AI output trick audiences into trusting it?
When AI generates professional-looking graphs, diagrams, and presentations, do audiences mistake visual polish for analytical depth? This matters because appearance might substitute for actual expertise.
the post-register failure mode at the artifact level
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Do LLMs produce texts with "human-like" lexical diversity?
- LLMs Get Lost In Multi-Turn Conversation
- Metadiscursive nouns in academic argument: ChatGPT vs student practices
- GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency
- What Makes a Good Natural Language Prompt?
- Intent Mismatch Causes LLMs to Get Lost in Multi-Turn Conversation
- Has the Creativity of Large-Language Models peaked? —an analysis of inter- and intra-LLM variability —
- DiaSynth: Synthetic Dialogue Generation Framework for Low Resource Dialogue Applications
Original note title
AI sycophantic chat register and falsely objective post register are two distinct generation modes