Beyond Correctness: Compute-Responsive Data Selection for Reasoning Model Post-Training
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Reasoning language models increasingly rely on test-time compute scaling, yet most existing work studies how to allocate inference computation while treating the model itself as fixed. We ask a complementary question: can reasoning models be post-trained to make better use of a given amount of test-time compute, and which examples are most useful for this goal? Our key observation is that reasoning problems differ substantially in their response to additional computation. Some are already solved under limited compute, others remain unresolved even after further reasoning, while a distinct subset changes from complete initial failure to success when additional reasoning is provided. We call these compute-responsive (CR) examples and introduce Compute-Responsive Data Selection (CRDS), a post-training data-selection principle that prioritizes examples with empirically demonstrated marginal utility from additional reasoning. On Qwen3-8B, SFT on CR examples recovers 45.3% of held-out low-compute failures, compared with 40.6% when training on already-solved examples. The advantage extends beyond the selected CR split: SFT-CR reaches 51.8% overall accuracy on an independently sampled test distribution, with the gain concentrated on compute-responsive problems. CR training also shifts the compute--accuracy frontier across inference budgets from 512 to 4,096 tokens, outperforming matched non-CR training throughout and reaching 48.1% recovery at the largest budget. The same pattern is supported across multiple data sources, remains visible under on-policy distillation, and extends to Llama-3.1-8B-Instruct when CR sets are reconstructed separately for that model. Better test-time compute utilization can therefore be learned through post-training, with recoverable responses to additional reasoning providing a particularly informative signal for selecting training examples.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 25 of its 30 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
25 of 30 references.
Closest ancestors · 5
Same direction, newest first
- 2026Not All Errors Are Equal: Consequence-Aware Reasoning Compute Allocation3 Jun
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing19 May
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
Other references · 20
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Let's Verify Step by Stepcited by 3,789
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
8 more
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 939
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2022Confident Adaptive Language Modelingcited by 310
- 2022Generating Sequences by Learning to Self-Correctcited by 277
- 2020FastBERT: a Self-distilling BERT with Adaptive Inference Timecited by 226
- 2020The Right Tool for the Job: Matching Model and Instance Complexitiescited by 126
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Post-Reasoning: Improving the Performance of Non-Thinking Models at No Cost
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning
- 2026Divergent-Convergent Reasoning: Scaling Test-Time Compute through Structured Solution Synthesis
- 2026Knowing When Thinking Is Not Enough: Teaching Small Reasoning Models to Reason Beyond Their Parametric Knowledge
- 2026Thinking by Subtraction: Confidence-Driven Contrastive Decoding for LLM Reasoning
- 2025Is That Your Final Answer? Test-Time Scaling Improves Selective Question Answering
- 2025First Try Matters: Revisiting the Role of Reflection in Reasoning Models
- 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs