TodoEvolve: Learning to Architect Agent Planning Systems
Not on the map. Why?
Abstract (arXiv)
Planning has become a central capability for contemporary agent systems in navigating complex, long-horizon tasks, yet existing approaches predominantly rely on fixed, hand-crafted planning structures that lack the flexibility to adapt to the structural diversity of open-ended problems. To address this limitation, we introduce TodoEvolve, a meta-planning paradigm that autonomously synthesizes and dynamically revises task-specific planning architectures. Specifically, we first construct PlanFactory, a modular design space that standardizes diverse planning paradigms within a unified codebase encompassing topology, initialization, adaptation, and navigation, thereby providing a common interface for heterogeneous planning patterns. Leveraging PlanFactory, we collect high-quality planning trajectories and train Todo-14B via textitImpedance-Guided Preference Optimization (IGPO), a multi-objective reinforcement learning objective that encourages the generation of planning systems that are performant, stable, and token-efficient across arbitrary tasks and agent backbones. Empirical evaluations on five agentic benchmarks demonstrate that TodoEvolve consistently surpasses carefully engineered planning modules while maintaining economical API costs and runtime overhead.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 8 Feb 2026.
Builds on
35 of 41 references.
References · 35
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2023GAIA: a benchmark for General AI Assistantscited by 1,084
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
23 more
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
- 2025Memory in the Age of AI Agentscited by 285
- 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 190
- 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 171
- 2025ToRL: Scaling Tool-Integrated RLcited by 166
- 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 129
- 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
- 2024Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planningcited by 95
- 2025Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agentscited by 75
- 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 68
- 2025TaskCraft: Automated Generation of Agentic Taskscited by 46
- 2024AGILE: A Novel Reinforcement Learning Framework of LLM Agentscited by 45
- 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 38
- 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
- 2025Deep Research: A Systematic Surveycited by 23
- 2025MoNaCo: More Natural and Complex Questions for Reasoning Across Dozens of Documentscited by 20
- 2025Learning When to Plan: Efficiently Allocating Test-Time Compute for LLM Agentscited by 18
- 2025PlanGEN: A Multi-Agent Framework for Generating Planning and Reasoning Trajectories for Complex Problem Solvingcited by 15
- 2025Encouraging Good Processes Without the Need for Good Answers: Reinforcement Learning for LLM Agent Planningcited by 15
- 2025Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Factscited by 12
- 2025GAP: Graph-Based Agent Planning with Parallel Tool Use and Reinforcement Learningcited by 11
- 2025HiMA-Ecom: Enabling Joint Training of Hierarchical Multi-Agent E-commerce Assistantscited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Learning Abstract World Model for Value-preserving Planning with Options
- 2026When to Plan: Learning to Select Between Reactive Control and Deliberative Planning
- 2026APEX: Autonomous Policy Exploration for Self-Evolving LLM Agents
- 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning
- 2025MPO: Boosting LLM Agents with Meta Plan Optimization
- 2025SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligence
- 2026MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learning
- 2026UnifiedPlayers: Enhance Tool-Integrated Reasoning in Agentic Reinforcement Learning