SYNTHESIS NOTE
Topics›Test Time Compute›this note

Why does more reasoning sometimes make models worse?

Explores whether extended thinking tokens genuinely improve model accuracy or can actively harm it by causing models to abandon correct answers mid-reasoning.

Synthesis note · 2026-07-17 · sourced from Test Time Compute

The dominant test-time-compute assumption is monotonic: more thinking, better answers. "When More Thinking Hurts" falsifies it with a specific mechanism. Tracking flip events — moments where the model, mid-trace, moves off an answer it had already reached — shows overthinking is not merely diminishing returns but active regression: extended reasoning is associated with abandoning previously-correct answers. Accuracy is therefore non-monotonic in trace length, not just concave.

This sharpens the vault's overthinking thread. Does more thinking time always improve reasoning accuracy? establishes that a threshold exists; the flip-event lens names what happens at it — the model second-guesses a correct commitment and talks itself out of it. It is distinct from Do reasoning models switch between ideas too frequently?: underthinking abandons a path too early before it pays off, whereas a flip event abandons a path that had already produced the right answer. Both are switching failures, but on opposite sides of the payoff.

The practical consequence is a measurement demand: report efficiency frontiers, not just accuracy-vs-budget curves. Because marginal utility falls sharply and can go negative, the paper's cost-aware framing shows stopping at a moderate budget can cut computation substantially while holding accuracy roughly constant — the extra tokens were buying flip risk, not correctness. This is a direct argument against uniform "think as long as possible" decoding.

Inquiring lines that read this note 7

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

What is the relationship between thinking tokens and reasoning accuracy? How does reasoning length affect model performance across different tasks? Why do token-level mechanisms matter for learning to reason? How do false presuppositions and sycophancy drive persistent false beliefs in models? How does harness optimization generalize across different model architectures and domains?

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
12 direct connections · 123 in 2-hop network ·dense cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

overthinking is a flip event — extended reasoning makes models abandon answers they had already gotten right