SYNTHESIS NOTE
Topics›Natural Language Inference›this note

Does high-frequency text homogenize user input before generation?

Does Adam's Law reveal how LLMs flatten distinctive user voices at the parsing stage, not just in output? This matters because it could explain why model accuracy and generic responses emerge from the same mechanism.

Synthesis note · 2026-05-02 · sourced from Natural Language Inference

Adam's Law surfaces a tension that earlier homogenization research could not localize. Do different AI models actually produce diverse outputs? documents output convergence; How much of the internet is AI-generated now? tracks that convergence at internet scale; Do LLMs compress concepts more aggressively than humans do? describes the representational mechanism. What was missing was an input-side account: how distinct user voices get flattened before the model starts generating.

Adam's Law supplies it. The model prefers high-frequency surface forms at the comprehension stage. Users iteratively rephrase their prompts toward higher quality, which empirically means toward higher frequency, which means toward median register. Distinct prompts — a domain expert's specialized phrasing, a regional dialect, a technical idiolect — get pre-processed by the user's own paraphrasing toward whatever phrasing the model handles best, which is whatever phrasing the corpus contained most. Homogenization happens in the parsing of the request, not just in the generation of the response.

The tension is sharp: the same property that gives LLMs their accuracy on common tasks — strong modeling of dense distributional regions — is the property that filters out distinctiveness on the input side. There is no cheap fix because the mechanism is constitutive of how the model works, not a bug in a post-processing layer. Tokenization-of-intelligence, in this frame, is tokenization toward the corpus mean; the input channel and the output channel both narrow toward the high-frequency centroid. A user with a distinctive voice trying to use the model effectively is in an asymmetric trade: speak distinctively and lose accuracy, or speak in the model's preferred register and lose voice. There is no third option that the architecture provides.

Inquiring lines that read this note 16

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How does AI-generated content undermine authentic engagement on social platforms? Do writers recognize when AI writing assistance alters their expressed stance? How does dialogue structure affect linguistic grounding and shared meaning? Can compression size predict model complexity better than parameter count alone? What safeguards enable trustworthy AI-assisted scientific peer review at scale? Can diffusion models match autoregressive performance on language generation tasks? How do surface patterns enable correct outputs but reduce robustness? How do prompt design choices influence model reasoning and performance? What enables genuine semantic understanding in language models? What articulatory and acoustic information does speech preserve that transcription destroys? How should items be represented and indexed in recommenders? How can we prevent synthetic data from contaminating statistical inference and corpora? How well do AI systems understand human social norms?

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
13 direct connections · 93 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

high-frequency text is the homogenization channel — the same mechanism that makes LLMs accurate also makes them generic