Do writers actually edit AI-generated text before publishing?
This research tests whether the "human-in-the-loop" safeguard against AI text quality issues actually works in practice. It examines how often writers revise AI-generated paragraphs and how substantially they change them.
A common reassurance about AI writing assistance is that humans remain in the loop — they will edit, correct, override. The persona-distortion study tested this assumption directly. Writers were given AI-generated paragraphs and asked to edit them until the text reflected their opinions to their satisfaction. The result: writers edited the AI-generated paragraphs only 23 percent of the time, and most edits were minor — median Levenshtein ratio of 0.96, meaning the edited text was 96 percent identical to the AI's original.
This finding has two implications. First, the standard "human-in-the-loop" defense against AI text quality concerns is empirically wrong at population scale. Editing is rare and shallow when it does occur. The AI's text is reaching its audience in nearly the form the model produced it. Second, this means the persona distortions documented in the same study — opinionated, confident, demographically privileged, emotionally compressed — propagate with minimal human modulation. The distortion is not filtered by the writer's revision; it is embraced or ignored.
This forecloses one common mitigation strategy: relying on the writer to detect and remove distortions before publication. The writer who would have caught and corrected the distortion is the same writer who, the study shows, mostly does not edit and mostly prefers the AI version even after being given the chance to edit it. The distortion arrives at the audience because the writer does not interrupt it. Any intervention that hopes to reduce AI's influence on public discourse cannot rely on the writer-as-gatekeeper assumption — that role, in practice, is not being performed.
Inquiring lines that use this note as a source 52
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
- Can AI text detectors reliably identify AI-generated websites?
- What makes AI-generated punditry different from human expert commentary online?
- What changes when published text was never written for its readers?
- How does the author-function itself change when AI replaces human authorship?
- Why can't algorithms distinguish between human and AI generated content quality?
- Do AI-generated posts crowd out human voices without any coordination or intent?
- Why does production time matter to the meaning of generated text?
- Does AI make writers appear more politically extreme to readers?
- Why does AI writing seem more competent and informative than human writing?
- Does AI writing make authors appear more privileged or educated?
- How does AI assistance affect perceived emotional tone in writing?
- Which reader-rated attributes converge most strongly when writers use AI?
- How does perceived writer confidence shift with AI-assisted composition?
- Does homogenization at the text level cause homogenization of perceived authors?
- What structural difference exists between AI posts and human conversational writing?
- Does AI writing erase markers of non-native English speaker identity?
- Can demographic distortion in AI writing affect who appears credible in public discourse?
- When do readers defer to AI text without genuine processing?
- What makes readers treat AI-generated text as authoritative?
- What specific distortions does AI writing assistance introduce into text?
- How do writer preferences for AI output affect their willingness to edit it?
- Can readers detect when text was written or heavily influenced by AI?
- Does transparency about AI use change how audiences trust the writing?
- What interventions beyond writer revision could reduce AI distortion in published content?
- What textual properties make AI writing feel polished and confident?
- Do AI writing models systematically change the tone or confidence of personal opinions?
- Do writers recognize when AI text misrepresents their actual stance?
- Does AI-assisted writing change how readers perceive the author's demographics or background?
- How do demographic and emotional compression relate to writing quality?
- Why might writers trust AI renderings of their views over their own words?
- Why do users prefer AI-polished versions of their own writing over originals?
- What reliable traces do generative processes actually leave in finished text?
- What would it take for readers to inspect rather than assume authorship?
- How do writers decide when to delegate work to AI versus doing it themselves?
- How do personalization errors differ from general accuracy problems in summaries?
- What properties of natural text does artificial text actually eliminate?
- Can we verify fabricated text without redesigning the generation process?
- Is statistical analysis the only reliable way to detect modern AI writing?
- What happens when AI generates content faster than humans can verify it?
- Can marking AI provenance solve the grounding problem for generated text?
- Why does AI-generated content feel flat compared to human commentary?
- Why do AI outputs lack the stable content of written sentences?
- What textual properties cause writers to prefer AI-rewritten versions of their text?
- How do AI rewrites systematically shift how writers appear across demographic dimensions?
- Can human researchers verify automated research methods before they become uninterpretable?
- What detection mechanisms work best for corruption-style document errors?
- Does AI writing style remain distinct when content is masked or paraphrased?
- Why do human stories land in statistically rarer regions than AI narratives?
- How do changes in human and AI writing distributions shift rarity measures over time?
- Do fluent generated summaries carry false authority over expert judgment?
- Can task framing influence whether writers experience genuine authorship during co-writing?
- What design changes could reduce unhelpful AI reliance in collaborative writing tools?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Measuring and Mitigating Persona Distortions from AI Writing Assistance
- StoryScope: Investigating idiosyncrasies in AI fiction
- Linguistic markers of inherently false AI communication and intentionally false human communication: Evidence from hotel reviews
- The Impact of AI-Generated Text on the Internet
- AI Enters Public Discourse: A Habermasian Assessment Of The Moral Status Of Large Language Models
- GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency
- Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?
- Do LLMs produce texts with "human-like" lexical diversity?
Original note title
The 23 percent edit rate of AI writing assistance establishes that distortions reach audiences in nearly unedited form