Think Again or Think Longer? Selective Verification for Budget-Aware Reasoning
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Test-time reasoning is increasingly used as a serving-time control knob, but extra reasoning is not uniformly valuable: it can repair failed attempts, waste compute on already-correct answers, or introduce harmful answer changes. We study this as a deployment allocation problem rather than a new-verifier problem. We introduce sevra, Selective Verification for Reasoning Allocation, a serving-layer controller that decides whether to preserve a frozen solver's initial answer or invoke active verification. Using a frozen Qwen3-4B solver, we log intervention outcomes and train recoverability-aware gates from serving-visible attempt state. On mathfive, selective verification reaches 76.3% accuracy, compared with 75.5% for always verifying, while reducing post-generation tokens by 26.8% and harmful flips from 2.2% to 1.0%. However, an 8,192-token initial solve reaches 76.0% accuracy with 28% fewer total model tokens, showing that selective recovery is useful but not the best tested cost frontier. In frozen transfer to gsm, the selective policy verifies only 3.0% of examples, improves accuracy from 93.4% to 94.5%, and reduces verification tokens by 91.2% relative to always verifying; again, a longer initial solve matches its accuracy with fewer realized tokens. On CommonsenseQA, always-on verification hurts, while Self-Consistency@5 improves accuracy at about five times the realized token cost. The resulting deployment rule is: tune the initial budget first, then use selective recovery when explicit checks, bounded retries, auditability, or regression-risk control matter.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 14 of its 33 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
14 of 33 references.
Closest ancestors · 7
Same direction, newest first
- 2026Adaptive Test-Time Compute Allocation for Reasoning LLMs via Constrained Policy Optimization16 Apr
- 2026Adaptive Test-Time Compute Allocation via Learned Heuristics over Categorical Structure3 Feb
- 2025LATTS: Locally Adaptive Test-Time Scaling16 Sep
- 2025s1: Simple test-time scaling31 Jan
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2023Large Language Models Cannot Self-Correct Reasoning Yet3 Oct
- 2022Language Models (Mostly) Know What They Know11 Jul
Other references · 7
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Let's Verify Step by Stepcited by 3,789
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2023Let's reward step by step: Step-Level reward model as the Navigators for Reasoningcited by 102
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Optimizing Anytime Reasoning via Budget Relative Policy Optimization
- 2026A Frozen 12B Beats Frontier Models on Verified Work: 100% Accuracy, 0 Tokens, Bit-Exact, Forever
- 2026Guarded Repair for Harm-Aware Post-hoc Replacement of LLM Mathematical Reasoning
- 2026What If We Allocate Test-Time Compute Adaptively?
- 2026Budget-Aware Anytime Reasoning with LLM-Synthesized Preference Data
- 2026Proof-Carrying Cognition: Closing the Verification Gap with Reality-Settled Reward
- 2026Adaptive Generate-Rank-Verify: Inference-Time Search with Costly Verification
- 2026Conformal Thinking: Risk Control for Reasoning on a Compute Budget