Can people reliably spot content made by AI?
This systematic review of 30 studies asks whether human judgment can distinguish AI-generated text, images, and voice from human-created content, and whether detection accuracy has improved as AI becomes more realistic.
This PRISMA-guided systematic review finds that human ability to tell generative AI content from human-produced content, across text, image and voice, "varied widely but generally clustered around chance performance." The search ran in Scopus, restricted to 2025 and 2026, and returned 22,541 records. Titles and abstracts were screened in relevance order until 1,200 had been reviewed, and 30 studies entered the synthesis. The review's summary is blunt: "humans are generally unreliable detectors of gen AI content." The Discussion makes the same point about the average. Humans "do not distinguish AI-generated content from human-generated content reliably better than chance," and human accuracy "has not meaningfully improved over time or at least has not improved at a pace that keeps up with the increasing realism of gen AI content."
The review does not compute a pooled estimate. It says "substantial methodological heterogeneity across studies limited the ability to compute pooled effect sizes," so its case rests on consistency across studies. It also reports that screening reached saturation, since "no eligible studies had been identified in the last 100 records" before it stopped. The modality pattern is the most specific claim in the excerpt. Voice detection succeeds more often than image detection, and image detection more often than text. For voice, the review cites work suggesting listeners may pick up "subtle artifacts in timing, pitch, or prosody." For images, the visual heuristics that might help (inconsistent reflections, unnatural textures, impossible lighting) still produce accuracy that "mostly did not vary convincingly from chance." These mechanisms are proposals from the cited literature. The review does not test them.
Read against the library, the review turns single-study findings into a cross-modality pattern. Can humans detect AI text if machines can measure it? and Can human judges detect measurable differences in AI text? both describe text that differs from human writing on measurable dimensions while judges fail to notice. This review extends that pattern across 30 studies and into image and voice. It does not check whether the measurable differences exist, because it measures human accuracy and nothing about the content itself. The text-level result, which is the most consequential for evaluation, is developed in Does polished writing actually signal better quality work?.
The excerpt does not establish several things a reader might want. It gives no per-study accuracy values, no per-modality figures, no confidence intervals and no chance baseline for each task. Its Table 1 is referenced but not included. So "around chance" is a summary of how the reviewed literature is distributed, and it carries the strength of a non-pooled review. The scope is bounded by design too: Scopus only, English only, 2025 to 2026, and the first 1,200 of 22,541 records by relevance, which the authors say may miss preprints and fast-moving computer science venues. The implication is that unaided human judgment is a weak basis for flagging AI content. The excerpt says nothing about automated detectors, and nothing about whether training or tools change the picture, so it cannot support a claim either way on those.
Inquiring lines that read this note 110
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Can AI-generated text be reliably distinguished from human writing?- How do lay readers differ from classifiers in detecting AI text?
- How much does the human-authorship halo affect AI evaluation across different task domains?
- Are detector errors on AI text systematic or random by design?
- Can AI detectors reliably distinguish human from machine-generated text?
- Can a classifier distinguish machine-written text from poor human writing?
- What signals do AI text detectors actually measure in their classification?
- Can detection systems identify AI text rewritten to match human author style?
- Would detectors trained on unaltered AI text catch heavily rewritten versions?
- Can AI-rewritten text still be detected as machine-modified?
- Can text detection methods distinguish between AI collaboration and delegation?
- Can user feedback flags rival AI detector accuracy for identifying AI slop?
- Can readers actually distinguish AI text from human writing?
- How accurate is Originality.ai's detector at identifying AI-written content?
- What differences exist between detector-based AI measurement methods across platforms?
- Can style and perspective be reliably separated by automated detection systems?
- Can readers distinguish machine-generated text from human-written comments?
- What prose features actually distinguish AI-generated text from human writing?
- Are AI systems trained to devalue content labeled as machine-generated?
- Which modality is easiest for humans to detect as AI?
- Can training or tools improve human detection of AI content?
- How do automated detectors compare to human judgment on AI?
- How do slop judgments correlate with actual AI detection performance in practice?
- How often do human annotators mistake human writing for AI-generated text?
- Can AI text detection improve enough to help evaluators make better decisions?
- Can polished AI text fool both reviewers and detection methods?
- How accurate are automated AI text detectors compared to human judgment?
- Can readers reliably distinguish AI-written abstracts from human-written ones?
- What prose features distinguish automatically generated text from human writing?
- Does AI output resemble Baudrillard's obscene surface detached from its scene?
- Can search performance data distinguish AI-generated content from human-written articles?
- Why do consumers show lower valid-view rates for AI-generated videos?
- What percentage of workplace communication now contains AI-generated content?
- Does artificial amplification of creator content weaken authentic social proof signals?
- How similar are GPT-generated fake profiles to real human profiles?
- Does detecting AI authorship actually improve social media feed quality?
- What metrics would prove an AI detection button is working?
- How accurate is the detector labeling these posts?
- Do mixed human-AI posts rank differently than fully generated content?
- Can volume-based moderation catch AI-generated top-level posts effectively?
- Do audiences penalize AI-written posts through visible callouts at scale?
- Does the 'feel of AI' in unedited posts trigger audience backlash and detection?
- How does YouTube identify which channels use AI-generated personas in practice?
- Are channels using AI voices without claiming expertise also affected by this policy?
- How should platforms balance removing AI content against wrongly limiting human reach?
- Can AI-generated content feel interchangeable while still delivering viewer satisfaction?
- What fraction of Reddit users are responsible for all machine-generated content?
- How does Reddit's AI prevalence compare to the broader internet?
- Why do accusations focus on gatekeeping rather than detecting AI?
- How robust is algorithmic content matching when controlling for creator characteristics and categories?
- Does algorithmic adjustment of AI content exposure hold as supply grows beyond twelve months?
- Can generic AI content harm discussions among people not using AI?
- Does AI intermediation reallocate attention across different types of content producers?
- How do we culturally discount AI-generated content the way we already discount advertising?
- Do Digital Services Act host protections apply to AI-generated content?
- Do AI-generated articles rank worse in Google Search than human-written ones?
- Do AI-generated articles receive less search traffic than human writing?
- Do AI-generated articles now dominate search results as organic traffic declines?
- How much of new web content is AI-generated by mid-2025?
- What false-positive rates do AI detectors show on mixed human-AI drafts?
- Why do false positive rates matter for AI content measurement?
- Can commercial AI detectors accurately identify AI-written application essays?
- Do admissions penalties follow actual AI detection or suspected authorship?
- Do human essays wrongly suspected of AI use also face rating penalties?
- How do citation errors in AI-generated papers differ from human hallucinations?
- Can AI systems distinguish fabricated papers from legitimate research?
- Can statistical detection of synthetic text identify actual fraudulent manuscripts?
- How do courts distinguish between AI hallucinations and ordinary typographical errors?
- Do AI detection tools assume false certainty about assessment integrity?
- How much do humans edit AI-generated text before publishing?
- Do human readers still recognize authors after heavy AI rewriting?
- What gap exists between how creators think they made work versus how audiences perceive it?
- How does salience of AI involvement shape judgments at the moment of reading?
- Does awareness of AI involvement make readers more critically scrutinize arguments?
- How much does knowing about AI use actually change how readers judge text?
- Does AI-written text score higher because of presentation alone or judgment shift?
- Do human reviewers detect rhetorical polish as a sign of AI authorship?
- How much does content type change whether readers expect human authorship?
- Do candidates prefer being screened by AI or by humans?
- How do live screening workflows differ from controlled experiments with labeled AI output?
- Why do people view AI-assisted work as less legitimate than human work?
- Can taste and judgment become the scarce resource in AI-assisted work?
- How do viewers react when they learn AI helped create channel content?
- What counts as human versus AI contribution in research disclosure?
- Does labeling AI content trigger skepticism even when audiences say they want honesty?
- Does transparency about AI-generated content actually build worker confidence?
- Does knowing about AI tools used change how persuasive or authentic content feels?
- Do informed readers scrutinize AI messages more while still finding them persuasive?
- Do populations with different AI exposure levels rate messages differently?
- What specific errors did participants report finding in the AI-generated reviews?
- Should rhetorical polish in AI reviews be separated from actual technical accuracy?
- What role should humans play in reviewing and approving AI-generated research?
- Does AI content in reviews correlate with differences in paper quality control?
- Can human reviewers reliably detect AI-written peer review text by sight?
- How does AI detection accuracy affect confidence in prevalence estimates?
- Can machine review catch flaws in AI-generated work that humans miss?
- Can humans reliably detect whether research text was written by AI?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can humans detect AI text if machines can measure it?
AI-generated text shows measurable differences from human writing across multiple linguistic dimensions, yet human judges consistently fail to identify it. Why does the gap between what is measurable and what is perceptible exist?
the same measurable-but-imperceptible pattern; this review extends it across 30 studies and three modalities.
-
Can human judges detect measurable differences in AI text?
Research shows LLM text differs statistically across six lexical dimensions, but human readers—even experts—cannot reliably identify which texts are AI-generated. Why does measurement succeed where human perception fails?
a single-study lexical finding in the same vein; the review measures no lexical features at all.
-
Does polished writing actually signal better quality work?
When evaluators judge applications and manuscripts, does rhetorical sophistication predict merit, or does it distract from verifiable evidence of competence and rigor?
the sibling note on the text subgroup, where the 58% figure and the perceived-quality finding are developed.
-
Why do newer AI models diverge further from human writing patterns?
As language models improve, they seem to generate text that is measurably less human-like in lexical patterns, yet humans struggle to detect this difference. What drives this divergence, and what does it reveal about how models optimize for quality?
evidence for: ChatGPT-4.5 and o4-mini diverge more from human lexical patterns yet are less detectable by human judges, widening the gap
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Is it Cake or is it AI? A Systematic Review of Human Uncertainty in Distinguishing Generative Artificial Intelligence Content
- The human-authorship halo: attribution bias in literary style evaluation by humans and AI
- Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews
- Machines in the Crowd? Measuring the Footprint of Machine-Generated Text on Reddit
- Do LLMs produce texts with "human-like" lexical diversity?
- AI Now Writes as Many Online Articles as Humans
- Linguistic markers of inherently false AI communication and intentionally false human communication: Evidence from hotel reviews
- Measuring AI "Slop" in Text
Original note title
human detection of generative AI content generally clusters around chance — a 30-study systematic review finds