A Primer in Post-Training Reasoning Data: What We Know About How It Works

Paper · arXiv 2606.02113 · Published June 1, 2026
Reinforcement Learning

Post-training has become a primary driver of recent progress in large reasoning models, and reasoning data are often the key variable determining whether this stage succeeds. Work on post-training reasoning data has grown rapidly, yet this literature remains scattered across dataset papers, reinforcement-learning recipes, reward-model studies, benchmarks, and frontier system reports. This paper is the first primer to synthesize over 150 key public studies and system reports on post-training reasoning data. We organize the field around four questions: what data objects exist, what makes them useful, how they are constructed, and how they scale. Together, this organization provides an attribution framework for future reasoningdata releases and post-training recipes.

Introduction. The training of large language models typically consists of two stages: pre-training and posttraining. With the rise of o1-style test-time scaling paradigms and thinking models, post-training has become increasingly important for further advancing model capabilities (OpenAI, 2024; DeepSeek- AI et al., 2025a). Recent studies suggest that, within the post-training pipeline, the quality and construction of training data often have a greater impact on model performance than other components, such as training algorithms or optimization strategies (Guha et al., 2025; He et al., 2025b; Xu et al., 2025b). However, despite the central role of data in post-training, there has not yet been a systematic survey dedicated to post-training data. This paper fills this gap. To the best of our knowledge, it is the first survey focused on post-training data, reviewing 150 key papers in this area and synthesizing practical insights into how post-training data is constructed, curated, and utilized.

Discussion / Conclusion. Post-training reasoning data have become the hidden substrate of reasoning-model progress, and the stream of releases is accelerating. The evidence reviewed here suggests that the reusable unit is not a prompt–response pair, but a verifier-bearing feedback interface whose value depends on the verifier, base model, lineage, optimizer, scaffold, and inference budget. The central unresolved question is therefore attribution: when a model improves, which part of that interface changed? This primer helps the community move from reporting gains to making them inspectable, comparable, and testable.

Lines of inquiry this paper opens 24

Research framings built by reading the notes related to this paper — the questions it feeds into.

How can process reward models supervise complex reasoning traces? Can prompting inject entirely new knowledge into language models? How does memorization interact with learning and generalization? Does recurrence enable reasoning capabilities that fixed-depth transformers cannot achieve? How do training data properties shape reasoning capability development? Does AI fluency substitute for verifiable accuracy in human judgment? What pretraining choices and baseline capability constrain reinforcement learning gains? What constrains reinforcement learning's ability to expand model reasoning? Do base models contain latent reasoning that training can unlock? Does decoupling planning from execution improve multi-step reasoning accuracy? Why does supervised fine-tuning improve accuracy while degrading reasoning quality? Do language model representations contain causally steerable task-specific features? What limits mechanistic interpretability's ability to characterize models? What capability tradeoffs emerge when scaling model reasoning abilities? Why does training format shape reasoning strategy more than domain content? Does fine-tuning modify underlying model capabilities or only behavioral outputs? How does policy entropy collapse constrain reasoning-focused reinforcement learning?