← All notes

What makes chain-of-thought reasoning actually work?

Examines how chain-of-thought reasoning works, what it's made of, and when it fails.

Topic Hub · 10 linked notes · 4 sections
View as

Sub-Maps

2 notes

What makes chain-of-thought reasoning actually work?

Explores the structural and mechanical properties that determine how reasoning traces function in language models. Understanding these properties reveals why format matters more than logic and what tokens carry the most information about correct answers.

Explore related Read →

Why does chain-of-thought reasoning fail in predictable ways?

Explores evidence that CoT failures stem from imitation of reasoning form rather than genuine inference. Examines distribution-bounded degradation, structural pattern matching, and error amplification across multiple failure modes.

Explore related Read →

Reasoning Step Taxonomy and Intervention

1 note

Can reasoning steps be dynamically pruned without losing accuracy?

This explores whether chain-of-thought reasoning contains redundant steps that can be identified and removed during inference. Understanding which steps matter could improve efficiency while maintaining correctness.

Explore related Read →

Writing Angles

2 notes

Why do more capable reasoning models ignore your instructions?

As AI models develop stronger reasoning abilities, they seem to follow instructions less reliably. What causes this counterintuitive trade-off, and how severe is the problem in practice?

Explore related Read →

What critical thinking skills do reasoning models actually lose?

Step-by-step reasoning training optimizes narrow deductive thinking while degrading meta-cognitive abilities like recognizing futile thinking and maintaining tentative reasoning. Understanding this tradeoff matters for deploying reasoning models reliably.

Explore related Read →