Efficient Test-Time Scaling via Temporal Reasoning Aggregation
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Test-time scaling improves the reasoning performance of large language models but often results in token-inefficient overthinking, where models continue reasoning beyond what is necessary for a correct answer. Existing dynamic early-exit methods typically rely on single-step confidence signals, which are often unreliable for detecting reasoning convergence in multi-step settings. To mitigate this limitation, we propose TRACE, a training-free framework for efficient test-time scaling that determines when to terminate reasoning based on temporal aggregation of multi-step evidence rather than instantaneous signals. TRACE detects reasoning convergence over time by aggregating two complementary signals across recent reasoning steps: answer consistency, capturing the persistence of predicted answers, and confidence trajectory, modeling the temporal evolution of model confidence. Benefiting from these two factors, TRACE can accurately determine whether the reasoning process has converged, thereby promptly halting inference and effectively avoiding redundant reasoning steps. Extensive experiments on multiple challenging benchmarks show that TRACE reduces reasoning token usage by 25-30% on average while maintaining accuracy within 1-2% of full-length reasoning, consistently outperforming existing dynamic reasoning methods.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 19 of its 39 references that are in the map. First posted on arXiv 19 Apr 2026.
Builds on
19 of 39 references.
Closest ancestors · 9
Same direction, newest first
- 2025Don't Think Twice! Over-Reasoning Impairs Confidence Calibration20 Aug
- 2025Efficient Reasoning for Large Reasoning Language Models via Certainty-Guided Reflection Suppression7 Aug
- 2025R-Stitch: Dynamic Trajectory Stitching for Efficient Reasoning23 Jul
- 2025Dynamic Early Exit in Reasoning Models22 Apr
- 2025Retro-Search: Exploring Untaken Paths for Deeper and Efficient Reasoning6 Apr
- 2025Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning25 Feb
- 2025The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks12 Feb
- 2024Efficiently Scaling LLM Reasoning with Certaindex30 Dec
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
Other references · 10
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
- 2025Training Language Models to Reason Efficientlycited by 242
- 2025Answer Convergence as a Signal for Early Stopping in Reasoningcited by 38
- 2025Z1: Efficient Test-time Scaling with Codecited by 35
- 2025CoCoEvo: Co-Evolution of Programs and Test Cases to Enhance Code Generationcited by 14
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025The Art of Scaling Test-Time Compute for Large Language Models
- 2026Test-Time Scaling in Reasoning LLMs: Inference Regimes, Evaluation, and Reproducibility
- 2026TRACES: Tagging Reasoning Steps for Adaptive Cost-Efficient Early-Stopping
- 2025ARISE: An Adaptive Resolution-Aware Metric for Test-Time Scaling Evaluation in Large Reasoning Models
- 2025Thought calibration: Efficient and confident test-time scaling
- 2026A Temporal Reasoning Benchmarking Framework for LRMs via Difficulty-controlled and Dynamic Test Generation
- 2025Tracing the Traces: Latent Temporal Signals for Efficient and Accurate Reasoning
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Models