Beyond ReAct: A Planner-Centric Framework for Complex Tool-Augmented LLM Reasoning
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Existing tool-augmented large language models (LLMs) encounter significant challenges when processing complex queries. Current frameworks such as ReAct are prone to local optimization traps due to their reliance on incremental decision-making processes. To address these limitations, we propose a novel Planner-centric Plan-Execute paradigm that fundamentally resolves local optimization bottlenecks through architectural innovation. Central to our approach is a novel Planner model that performs global Directed Acyclic Graph (DAG) planning for complex queries, enabling optimized execution beyond conventional tool coordination. We also introduce ComplexTool-Plan, a large-scale benchmark dataset featuring complex queries that demand sophisticated multi-tool composition and coordination capabilities. Additionally, we develop a two-stage training methodology that integrates Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO), systematically enhancing the Planner's tool selection accuracy and global planning awareness through structured DAG-based planning. When integrated with a capable executor, our framework achieves state-of-the-art performance on the StableToolBench benchmark for complex user queries, demonstrating superior end-to-end execution capabilities and robust handling of intricate multi-tool workflows.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 16 of its 39 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
16 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
- 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
- 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 560
- 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 103
- 2023ModelScope-Agent: Building Your Customizable Agent System with Open-source Large Language Modelscited by 24
3 more
- 2025Towards AI Search Paradigmcited by 19
- 2025Divide-Then-Aggregate: An Efficient Tool Learning Method via Parallel Tool Invocationcited by 16
- 2025TURA: Tool-Augmented Unified Retrieval Agent for AI Searchcited by 6
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agentscited by 17
- 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discoverycited by 11
- 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planningcited by 9
- 2026Brain-Inspired Graph Multi-Agent Systems for LLM Reasoningcited by 6
- 2026Don't Stop Early: Scalable Enterprise Deep Research with Controlled Information Flow and Evidence-Aware Terminationcited by 4
- 2026MM-StanceDet: Retrieval-Augmented Multi-modal Multi-agent Stance Detectioncited by 3
- 2026Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineeringcited by 2
- 2026STAR: Failure-Aware Markovian Routing for Multi-Agent Spatiotemporal Reasoningcited by 1
- 2026Conflict-Resilient Multi-Agent Reasoning via Signed Graph Modelingcited by 1
- 2026DiG-Plan: Mitigating Early Commitment for Tool-Graph Planning via Diffusion Guidancecited by 1
- 2026Decoupling Strategy and Execution in Task-Focused Dialogue via Goal-Oriented Preference Optimizationcited by 0
- 2026Robust and Efficient Tool Orchestration via Layered Execution Structures with Reflective Correctioncited by 0
5 more
- 2026UniCreative: Unifying Long-form Logic and Short-form Sparkle via Reference-Free Reinforcement Learningcited by 0
- 2026Retrieval-Augmented Multimodal Model for Fake News Detectioncited by 0
- 2026From Intent to Execution: Composing Agentic Workflows with Agent Recommendationcited by 0
- 2026PersonalPlan: Planning Multi-Agent Systems for Personalized Programming Learningcited by 0
- 2026Should SLMs be in the Driver's Seat? A Study of Local Models as Interpreters in Cloud-Written Agent Programscited by 0
- 2026Should SLMs be in the Driver's Seat? A Study of Local Models as Interpreters in Cloud-Written Agent Programs9 Oct 2026
- 2026Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineering27 Jul 2026
- 2026PersonalPlan: Planning Multi-Agent Systems for Personalized Programming Learning17 Jun 2026
- 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agents4 Jun 2026
- 2026DiG-Plan: Mitigating Early Commitment for Tool-Graph Planning via Diffusion Guidance4 Jun 2026
- 2026Conflict-Resilient Multi-Agent Reasoning via Signed Graph Modeling19 May 2026
- 2026STAR: Failure-Aware Markovian Routing for Multi-Agent Spatiotemporal Reasoning11 May 2026
- 2026From Intent to Execution: Composing Agentic Workflows with Agent Recommendation5 May 2026
- 2026MM-StanceDet: Retrieval-Augmented Multi-modal Multi-agent Stance Detection30 Apr 2026
- 2026Don't Stop Early: Scalable Enterprise Deep Research with Controlled Information Flow and Evidence-Aware Termination27 Apr 2026
- 2026Retrieval-Augmented Multimodal Model for Fake News Detection20 Apr 2026
- 2026UniCreative: Unifying Long-form Logic and Short-form Sparkle via Reference-Free Reinforcement Learning7 Apr 2026
5 more
- 2026Brain-Inspired Graph Multi-Agent Systems for LLM Reasoning16 Mar 2026
- 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discovery6 Mar 2026
- 2026Robust and Efficient Tool Orchestration via Layered Execution Structures with Reflective Correction21 Feb 2026
- 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planning14 Feb 2026
- 2026Decoupling Strategy and Execution in Task-Focused Dialogue via Goal-Oriented Preference Optimization24 Jan 2026
- 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discoverycited by 11
- 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planningcited by 9
- 2026Robust and Efficient Tool Orchestration via Layered Execution Structures with Reflective Correctioncited by 0
- 2026From Intent to Execution: Composing Agentic Workflows with Agent Recommendationcited by 0
- 2026PersonalPlan: Planning Multi-Agent Systems for Personalized Programming Learningcited by 0
- 2026PersonalPlan: Planning Multi-Agent Systems for Personalized Programming Learning17 Jun 2026
- 2026From Intent to Execution: Composing Agentic Workflows with Agent Recommendation5 May 2026
- 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discovery6 Mar 2026
- 2026Robust and Efficient Tool Orchestration via Layered Execution Structures with Reflective Correction21 Feb 2026
- 2026PhGPO: Pheromone-Guided Policy Optimization for Long-Horizon Tool Planning14 Feb 2026
- 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agentscited by 17
- 2026Brain-Inspired Graph Multi-Agent Systems for LLM Reasoningcited by 6
- 2026STAR: Failure-Aware Markovian Routing for Multi-Agent Spatiotemporal Reasoningcited by 1
- 2026Conflict-Resilient Multi-Agent Reasoning via Signed Graph Modelingcited by 1
- 2026When Tools Fail: Benchmarking Dynamic Replanning and Anomaly Recovery in LLM Agents4 Jun 2026
- 2026Conflict-Resilient Multi-Agent Reasoning via Signed Graph Modeling19 May 2026
- 2026STAR: Failure-Aware Markovian Routing for Multi-Agent Spatiotemporal Reasoning11 May 2026
- 2026Brain-Inspired Graph Multi-Agent Systems for LLM Reasoning16 Mar 2026
- 2026Don't Stop Early: Scalable Enterprise Deep Research with Controlled Information Flow and Evidence-Aware Terminationcited by 4
- 2026Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineeringcited by 2
- 2026DiG-Plan: Mitigating Early Commitment for Tool-Graph Planning via Diffusion Guidancecited by 1
- 2026Should SLMs be in the Driver's Seat? A Study of Local Models as Interpreters in Cloud-Written Agent Programscited by 0
- 2026Should SLMs be in the Driver's Seat? A Study of Local Models as Interpreters in Cloud-Written Agent Programs9 Oct 2026
- 2026Matryoshka Agent: Unfolding Sub-Agents for Long-Horizon Machine Learning Engineering27 Jul 2026
- 2026DiG-Plan: Mitigating Early Commitment for Tool-Graph Planning via Diffusion Guidance4 Jun 2026
- 2026Don't Stop Early: Scalable Enterprise Deep Research with Controlled Information Flow and Evidence-Aware Termination27 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2024Tool-Planner: Task Planning with Clusters across Multiple Tools
- 2026ToolTree: Efficient LLM Agent Tool Planning via Dual-Feedback Monte Carlo Tree Search and Bidirectional Pruning
- 2024LLM With Tools: A Survey
- 2024Exploring and Benchmarking the Planning Capabilities of Large Language Models
- 2026Internalizing Tool Knowledge in Small Language Models via QLoRA Fine-Tuning
- 2025Complex LLM Planning via Automated Heuristics Discovery
- 2026HyperAgent: Planning and Acting over Tool-Schema Hypergraphs for Tool-Use LLM Agents
- 2026Long-Horizon Plan Execution in Large Tool Spaces through Entropy-Guided Branching