Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Language model (LM)-based agents have demonstrated promising capabilities in automating complex tasks from natural language instructions, yet they continue to struggle with long-horizon planning and reasoning. To address this, we propose an enhanced multi-agent framework that decomposes automation into three roles: a planner for high-level decision-making, an actor for task execution, and a memory manager for contextual reasoning. While this modular decomposition aligns with established design patterns, our core contribution lies in a systematic compute-allocation analysis, revealing that planning is the dominant factor influencing task performance. Execution and memory management require significantly less compute and model capacity to achieve competitive results. Building on these insights, we introduce a planner-centric reinforcement learning approach, which exclusively optimizes the planner using trajectory-level rewards from a VLM-as-judge, while freezing the other components. Extensive experiments on benchmarks spanning web navigation, OS control, and tool use demonstrate that concentrating model capacity and learning on high-level planning yields robust and compute-efficient improvements in long-horizon agent automation. Our code is publicly released.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 56 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
36 of 56 references.
Closest ancestors · 2
Same direction, newest first
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks12 Mar
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
Other references · 34
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
22 more
- 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 424
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
- 2024An Introduction to Vision-Language Modelingcited by 175
- 2023ADaPT: As-Needed Decomposition and Planning with Language Modelscited by 172
- 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 162
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 155
- 2025MCP-Bench: Benchmarking Tool-Using LLM Agents with Complex Real-World Tasks via MCP Serverscited by 101
- 2025Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judgecited by 75
- 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agentscited by 68
- 2025In-the-Flow Agentic System Optimization for Effective Planning and Tool Usecited by 67
- 2025BacktrackAgent: Enhancing GUI Agent with Error Detection and Backtracking Mechanismcited by 25
- 2025Auto-scaling Continuous Memory for GUI Agentcited by 19
- 2025MGA: Memory-Driven GUI Agent for Observation-Centric Interactioncited by 18
- 2025Towards General Continuous Memory for Vision-Language Modelscited by 14
- 2026Hybrid Self-evolving Structured Memory for GUI Agentscited by 12
- 2025COLA: A Scalable Multi-Agent Framework For Windows UI Task Automationcited by 9
- 2026Why Do LLM-based Web Agents Fail? A Hierarchical Planning Perspectivecited by 9
- 2025WebSight: A Vision-First Architecture for Robust Web Agentscited by 7
- 2026Enhancing Web Agents with a Hierarchical Memory Treecited by 5
- 2026Anticipatory Planning for Multimodal AI Agentscited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Learning When to Plan: Efficiently Allocating Test-Time Compute for LLM Agents
- 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments
- 2025ELHPlan: Efficient Long-Horizon Task Planning for Multi-Agent Collaboration
- 2025Robotouille: An Asynchronous Planning Benchmark for LLM Agents
- 2024LaMMA-P: Generalizable Multi-Agent Long-Horizon Task Allocation and Planning with LM-Driven PDDL Planner
- 2026A Subgoal-driven Framework for Improving Long-Horizon LLM Agents
- 2026Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning
- 2025A Goal Without a Plan Is Just a Wish: Efficient and Effective Global Planner Training for Long-Horizon Agent Tasks