Planned Test-Time Scaling with Coordinated Reasoning Paths
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Test-time scaling with parallel branches is widely adopted to improve performance on challenging reasoning tasks. The predominant approach, repeated sampling, draws branches independently from a single policy, which can produce redundant attempts and thereby limit the gains from additional inference compute. To address this limitation, we propose Planned Test-Time Scaling (PTTS), which replaces independent sampling with a coordinated joint policy: a planner generates a solution outline for each branch, steering the branches toward distinct reasoning paths, and an executor produces a full solution conditioned on each outline. Formally, we show that PTTS strictly generalizes repeated sampling and, in a stylized setting, provably promotes coverage of complementary reasoning modes and yields better pass@k scaling. We instantiate PTTS on top of strong reasoning models, keeping them fixed as executors while replacing repeated sampling with PTTS inference to further enhance test-time scaling. Concretely, we develop two variants: PTTS-ZS prompts a model to jointly generate outlines for all branches in a single autoregressive pass, while PTTS-RL directly optimizes the planner against the pass@k reward using truncated execution rollouts for efficient training and a sharper reward signal. Across five mathematical reasoning benchmarks with Qwen3-1.7B and 4B, PTTS-ZS improves pass@64 over repeated sampling by up to 6.7 points, while PTTS-RL further increases the gain to up to 13.4 points. Further analysis indicates that broader coverage of distinct reasoning paths contributes to these gains. Overall, PTTS provides a general framework for improving test-time scaling by coordinating reasoning branches, with zero-shot and trainable instantiations that yield substantial performance gains.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 26 of its 30 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
26 of 30 references.
Closest ancestors · 3
Same direction, newest first
- 2025e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMs10 Jun
- 2025A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?31 Mar
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
Other references · 23
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 559
- 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 485
- 2025Pass@k Training for Adaptively Balancing Exploration and Exploitation of Large Reasoning Modelscited by 138
- 2026Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMscited by 137
- 2025The Invisible Leash: Why RLVR May or May Not Escape Its Origincited by 97
11 more
- 2025Pass@K Policy Optimization: Solving Harder Reinforcement Learning Problemscited by 87
- 2025Jointly Reinforcing Diversity and Quality in Language Model Generationscited by 80
- 2025Optimizing Language Models for Inference Time Objectives using Reinforcement Learningcited by 53
- 2025Diversity-Aware Policy Optimization for Large Language Model Reasoningcited by 41
- 2025On the Effect of Sampling Diversity in Scaling LLM Inferencecited by 18
- 2025Risk-Sensitive RL for Alleviating Exploration Dilemmas in Large Language Modelscited by 14
- 2025RiskPO: Risk-based Policy Optimization via Verifiable Reward for LLM Post-Trainingcited by 12
- 2025GuidedSampling: Steering LLMs Towards Diverse Candidate Solutions at Inference-Timecited by 5
- 2025Explore-Execute Chain: Towards an Efficient Structured Reasoning Paradigmcited by 2
- 2025The Road Less Traveled: Enhancing Exploration in LLMs via Sequential Samplingcited by 2
- 2026Cast a Wider Net: Coordinated Pass@K Policy Optimization for Code Reasoningcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Scaling over Scaling: Exploring Test-Time Scaling Plateau in Large Reasoning Models
- 2026What If We Allocate Test-Time Compute Adaptively?
- 2025ARISE: An Adaptive Resolution-Aware Metric for Test-Time Scaling Evaluation in Large Reasoning Models
- 2025Extending Test-Time Scaling: A 3D Perspective with Context, Batch, and Turn
- 2026Test-Time Scaling in Reasoning LLMs: Inference Regimes, Evaluation, and Reproducibility
- 2026Efficient Test-Time Scaling via Temporal Reasoning Aggregation
- 2026APR: Penalizing Structural Redundancy in Large Reasoning Models via Anchor-based Process Rewards
- 2026Thought-Level Beam Search for Reasoning