Test-Time Scaling via Error Localization
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Scaling inference-time computation has emerged as a reliable method to improve the performance of large language models on complex reasoning and programming tasks. However, standard approaches such as independent sampling and sequential multi-turn refinement operate without token-level credit assignment, resulting in computational inefficiency, since valid reasoning prefixes are frequently discarded. In this work, we introduce Test-Time Scaling via Error Localization (TTEL), an inference-time algorithm that utilizes fixed or environment feedback to perform token-level error localization. By comparing conditional probabilities under informed feedback against a null-context baseline, TTEL isolates the step at which an error occurred. The algorithm then truncates the trajectory and branches a new generation, maximally reusing the valid prefix. Extensive evaluations demonstrate that TTEL establishes strictly dominating Pareto frontiers across sequential reasoning domains, measured by pass-at-k vs. generated-token cost. With Qwen3-8B on LiveCodeBench, TTEL attains a pass@64 of 71.0% while generating approximately half as many tokens as independent sampling (360.4k vs. 735.0k). Generalizing to math benchmarks AIME-2025 and HMMT-2025, TTEL cleanly outperforms competing test-time baselines across both Qwen3-8B and Qwen3-4B-Thinking-2507.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 36 of its 39 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
36 of 39 references.
Closest ancestors · 9
Same direction, newest first
- 2025Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models30 Sep
- 2025s1: Simple test-time scaling31 Jan
- 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs30 Dec
- 2024Training Language Models to Self-Correct via Reinforcement Learning19 Sep
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2024V-STaR: Training Verifiers for Self-Taught Reasoners9 Feb
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Models17 May
- 2023Self-Refine: Iterative Refinement with Self-Feedback30 Mar
- 2022STaR: Bootstrapping Reasoning With Reasoning28 Mar
Other references · 27
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Let's Verify Step by Stepcited by 3,598
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 946
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
15 more
- 2022PAL: Program-aided Language Modelscited by 635
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 426
- 2022Complexity-Based Prompting for Multi-Step Reasoningcited by 387
- 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
- 2026Reinforcement Learning via Self-Distillationcited by 285
- 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 275
- 2026Self-Distillation Enables Continual Learningcited by 212
- 2026On-Policy Context Distillation for Language Modelscited by 161
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2024RRM: Robust Reward Model Training Mitigates Reward Hackingcited by 75
- 2026Expanding the Capabilities of Reinforcement Learning via Text Feedbackcited by 49
- 2024CARMO: Dynamic Criteria Generation for Context-Aware Reward Modellingcited by 21
- 2025Robust Reward Modeling via Causal Rubricscited by 18
- 2026Improving Interactive In-Context Learning from Natural Language Feedbackcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Revisiting Test-Time Scaling: A Survey and a Diversity-Aware Method for Efficient Reasoning
- 2025The Art of Scaling Test-Time Compute for Large Language Models
- 2025Are We Scaling the Right Thing? A System Perspective on Test-Time Scaling
- 2026Test-Time Scaling in Reasoning LLMs: Inference Regimes, Evaluation, and Reproducibility
- 2026ThinkBooster: A Unified Framework for Seamless Test-Time Scaling of LLM Reasoning
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Models
- 2025Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models
- 2025ARISE: An Adaptive Resolution-Aware Metric for Test-Time Scaling Evaluation in Large Reasoning Models