SYNTHESIS NOTE
Topics›Co Writing Collaboration›this note

Do writers actually edit AI-generated text before publishing?

This research tests whether the "human-in-the-loop" safeguard against AI text quality issues actually works in practice. It examines how often writers revise AI-generated paragraphs and how substantially they change them.

Synthesis note · 2026-05-01 · sourced from Co Writing Collaboration
How do people decide what to share with AI systems?

A common reassurance about AI writing assistance is that humans remain in the loop — they will edit, correct, override. The persona-distortion study tested this assumption directly. Writers were given AI-generated paragraphs and asked to edit them until the text reflected their opinions to their satisfaction. The result: writers edited the AI-generated paragraphs only 23 percent of the time, and most edits were minor — median Levenshtein ratio of 0.96, meaning the edited text was 96 percent identical to the AI's original.

This finding has two implications. First, the standard "human-in-the-loop" defense against AI text quality concerns is empirically wrong at population scale. Editing is rare and shallow when it does occur. The AI's text is reaching its audience in nearly the form the model produced it. Second, this means the persona distortions documented in the same study — opinionated, confident, demographically privileged, emotionally compressed — propagate with minimal human modulation. The distortion is not filtered by the writer's revision; it is embraced or ignored.

This forecloses one common mitigation strategy: relying on the writer to detect and remove distortions before publication. The writer who would have caught and corrected the distortion is the same writer who, the study shows, mostly does not edit and mostly prefers the AI version even after being given the chance to edit it. The distortion arrives at the audience because the writer does not interrupt it. Any intervention that hopes to reduce AI's influence on public discourse cannot rely on the writer-as-gatekeeper assumption — that role, in practice, is not being performed.

Inquiring lines that read this note 69

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

What linguistic features distinguish AI-generated text from human writing most reliably? How does AI-generated content undermine authentic engagement on social platforms? Do writers recognize when AI writing assistance alters their expressed stance? Why do people disclose to AI systems despite their artificial nature? How can we prevent synthetic data from contaminating statistical inference and corpora? Does abstract user knowledge outperform concrete interaction history in personalization? Why does polished presentation create unearned authority in AI outputs? How does the generation-verification gap limit what we can measure about AI reasoning? When do semantic similarity approaches miss structural retrieval failures? How should designers communicate what AI systems truly are and can do? How do social dynamics distort aggregated online ratings? Does AI assistance promote real skill development or substitute for independent learning? How can AI chatbots provide therapeutic benefit without causing harm? What safeguards enable trustworthy AI-assisted scientific peer review at scale?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

The 23 percent edit rate of AI writing assistance establishes that distortions reach audiences in nearly unedited form