SYNTHESIS NOTE
Topics›Expertise in the Age of AI Content›this note

Can people reliably spot content made by AI?

This systematic review of 30 studies asks whether human judgment can distinguish AI-generated text, images, and voice from human-created content, and whether detection accuracy has improved as AI becomes more realistic.

Synthesis note · 2026-10-06 · sourced from Expertise in the Age of AI Content

This PRISMA-guided systematic review finds that human ability to tell generative AI content from human-produced content, across text, image and voice, "varied widely but generally clustered around chance performance." The search ran in Scopus, restricted to 2025 and 2026, and returned 22,541 records. Titles and abstracts were screened in relevance order until 1,200 had been reviewed, and 30 studies entered the synthesis. The review's summary is blunt: "humans are generally unreliable detectors of gen AI content." The Discussion makes the same point about the average. Humans "do not distinguish AI-generated content from human-generated content reliably better than chance," and human accuracy "has not meaningfully improved over time or at least has not improved at a pace that keeps up with the increasing realism of gen AI content."

The review does not compute a pooled estimate. It says "substantial methodological heterogeneity across studies limited the ability to compute pooled effect sizes," so its case rests on consistency across studies. It also reports that screening reached saturation, since "no eligible studies had been identified in the last 100 records" before it stopped. The modality pattern is the most specific claim in the excerpt. Voice detection succeeds more often than image detection, and image detection more often than text. For voice, the review cites work suggesting listeners may pick up "subtle artifacts in timing, pitch, or prosody." For images, the visual heuristics that might help (inconsistent reflections, unnatural textures, impossible lighting) still produce accuracy that "mostly did not vary convincingly from chance." These mechanisms are proposals from the cited literature. The review does not test them.

Read against the library, the review turns single-study findings into a cross-modality pattern. Can humans detect AI text if machines can measure it? and Can human judges detect measurable differences in AI text? both describe text that differs from human writing on measurable dimensions while judges fail to notice. This review extends that pattern across 30 studies and into image and voice. It does not check whether the measurable differences exist, because it measures human accuracy and nothing about the content itself. The text-level result, which is the most consequential for evaluation, is developed in Does polished writing actually signal better quality work?.

The excerpt does not establish several things a reader might want. It gives no per-study accuracy values, no per-modality figures, no confidence intervals and no chance baseline for each task. Its Table 1 is referenced but not included. So "around chance" is a summary of how the reviewed literature is distributed, and it carries the strength of a non-pooled review. The scope is bounded by design too: Scopus only, English only, 2025 to 2026, and the first 1,200 of 22,541 records by relevance, which the authors say may miss preprints and fast-moving computer science venues. The implication is that unaided human judgment is a weak basis for flagging AI content. The excerpt says nothing about automated detectors, and nothing about whether training or tools change the picture, so it cannot support a claim either way on those.

Inquiring lines that read this note 110

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Can AI-generated text be reliably distinguished from human writing? How does AI-generated content affect trust in social conversations? How do AI-generated summaries affect traffic and engagement with original sources? How reliably can detection systems identify AI-generated hallucinations and false claims? When readers detect AI involvement, does it undermine writer credibility? Can employers detect AI-assisted applications and should they be permitted? How should evaluation expand to capture deployment realities? How does increased AI involvement reshape human agency and accountability? Do confidence signals reliably indicate whether AI models will succeed or fail? Does disclosing AI involvement change how audiences evaluate content trust? Can warnings effectively reduce AI's persuasive influence on audiences? Does polished AI presentation mislead people about accuracy? Can mechanistic interpretability reliably explain model reasoning and guide interventions? Can machine reviewers detect manuscript flaws that human experts miss? How does AI assistance affect human cognitive skill development over time? How can verification systems keep pace with AI generation? How do clinicians assess, trust, and effectively use medical AI in practice? How do AI systems ground research citations against hallucination? Why do users misjudge the credibility of AI-generated and verified content? Can humans maintain meaningful oversight as AI systems become more autonomous? How do user perceptions and UI design drive consciousness attribution to AI? Which task types benefit from human-AI collaboration and how should work divide? How do confidence signals and expertise language mislead users' trust calibration?

Related concepts in this collection 4

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
17 direct connections · 119 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

human detection of generative AI content generally clusters around chance — a 30-study systematic review finds