Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning
On the map: LLM reasoning → Prompting and chain-of-thought reasoning
Abstract (arXiv)
Current plan-based reasoning methods improve large language models (LLMs) by inserting a planning stage before execution, giving rise to the question rightarrow plan rightarrow cot paradigm. While effective, a closer examination reveals an inherent paradigm-level gap: both the planning and its execution stages decide how to solve a problem, while the prior question of what to solve; recognizing the problem type, the applicable tools, and the foreseeable pitfalls; remains entirely implicit. To bridge this gap, we propose PPC (Preplan-Plan-CoT), a framework that introduces an explicit problem-understanding stage, the preplan, yielding a new question rightarrow preplan rightarrow plan rightarrow cot paradigm. Realizing this paradigm requires safeguarding the conceptual integrity of preplan at both ends. Specifically, we design a three-stage synthesis pipeline with a spoiler-score detector that filters out leakage and spoiler failures to build clean preplan supervision, and a composite GRPO reward enforces that the generated plan genuinely follows from the preplan. Experiments across four backbones and five mathematical reasoning benchmarks show that PPC achieves the best results on 39 of 40 metrics, improving maj@16 and pass@16 by +2.23 and +3.06 over the strongest baseline without introducing additional inference token overhead.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompting and chain-of-thought reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 28 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
18 of 28 references.
Closest ancestors · 2
Same direction, newest first
- 2026Hierarchical Chain-of-Thought: Enhancing LLM Reasoning Performance and Efficiency31 Mar
- 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Models21 May
Other references · 16
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Let's Verify Step by Stepcited by 3,598
- 2024Qwen2 Technical Reportcited by 2,076
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
- 2025LIMO: Less is More for Reasoningcited by 488
- 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 328
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2025DeepMath-103K: A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoningcited by 261
4 more
- 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 165
- 2025Skywork Open Reasoner 1 Technical Reportcited by 161
- 2025Plan Then Action:High-Level Planning Guidance Reinforcement Learning for LLM Reasoningcited by 17
- 2025HyperTree Planning: Enhancing LLM Reasoning via Hierarchical Thinkingcited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Chain of Thoughtlessness? An Analysis of CoT in Planning
- 2025CRISP: Complex Reasoning with Interpretable Step-based Plans
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models
- 2025Can Pruning Improve Reasoning? Revisiting Long-CoT Compression with Capability in Mind for Better Reasoning
- 2026PPA-Plan: Proactive Pitfall Avoidance for Reliable Planning in Long-Context LLM Reasoning
- 2025Plan before Solving: Problem-Aware Strategy Routing for Mathematical Reasoning with LLMs
- 2026Constraint-First Reasoning: A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solving
- 2025A Survey on Large Language Models for Mathematical Reasoning