mlsanityData to 7 Oct 2026

TodoEvolve: Learning to Architect Agent Planning Systems

arXiv 2602.07839 ↗First posted 8 Feb 2026cs.CL cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Planning has become a central capability for contemporary agent systems in navigating complex, long-horizon tasks, yet existing approaches predominantly rely on fixed, hand-crafted planning structures that lack the flexibility to adapt to the structural diversity of open-ended problems. To address this limitation, we introduce TodoEvolve, a meta-planning paradigm that autonomously synthesizes and dynamically revises task-specific planning architectures. Specifically, we first construct PlanFactory, a modular design space that standardizes diverse planning paradigms within a unified codebase encompassing topology, initialization, adaptation, and navigation, thereby providing a common interface for heterogeneous planning patterns. Leveraging PlanFactory, we collect high-quality planning trajectories and train Todo-14B via textitImpedance-Guided Preference Optimization (IGPO), a multi-objective reinforcement learning objective that encourages the generation of planning systems that are performant, stable, and token-efficient across arbitrary tasks and agent backbones. Empirical evaluations on five agentic benchmarks demonstrate that TodoEvolve consistently surpasses carefully engineered planning modules while maintaining economical API costs and runtime overhead.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 35 of its 41 references that are in the map. First posted on arXiv 8 Feb 2026.

Builds on

35 of 41 references.

References · 35

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  6. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  7. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  8. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
  9. 2023GAIA: a benchmark for General AI Assistantscited by 1,084
  10. 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
  11. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  12. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
23 more
  1. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  2. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
  3. 2025Memory in the Age of AI Agentscited by 285
  4. 2025Plan-and-Act: Improving Planning of Agents for Long-Horizon Taskscited by 190
  5. 2025WebWalker: Benchmarking LLMs in Web Traversalcited by 171
  6. 2025ToRL: Scaling Tool-Integrated RLcited by 166
  7. 2025OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automationcited by 129
  8. 2025xbench: Tracking Agents Productivity Scaling with Profession-Aligned Real-World Evaluationscited by 118
  9. 2024Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planningcited by 95
  10. 2025Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agentscited by 75
  11. 2025AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learningcited by 68
  12. 2025TaskCraft: Automated Generation of Agentic Taskscited by 46
  13. 2024AGILE: A Novel Reinforcement Learning Framework of LLM Agentscited by 45
  14. 2025Large Language Models for Planning: A Comprehensive and Systematic Surveycited by 38
  15. 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
  16. 2025Deep Research: A Systematic Surveycited by 23
  17. 2025MoNaCo: More Natural and Complex Questions for Reasoning Across Dozens of Documentscited by 20
  18. 2025Learning When to Plan: Efficiently Allocating Test-Time Compute for LLM Agentscited by 18
  19. 2025PlanGEN: A Multi-Agent Framework for Generating Planning and Reasoning Trajectories for Complex Problem Solvingcited by 15
  20. 2025Encouraging Good Processes Without the Need for Good Answers: Reinforcement Learning for LLM Agent Planningcited by 15
  21. 2025Co-Sight: Enhancing LLM-Based Agents via Conflict-Aware Meta-Verification and Trustworthy Reasoning with Structured Factscited by 12
  22. 2025GAP: Graph-Based Agent Planning with Parallel Tool Use and Reinforcement Learningcited by 11
  23. 2025HiMA-Ecom: Enabling Joint Training of Hierarchical Multi-Agent E-commerce Assistantscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Learning Abstract World Model for Value-preserving Planning with Options
  2. 2026When to Plan: Learning to Select Between Reactive Control and Deliberative Planning
  3. 2026APEX: Autonomous Policy Exploration for Self-Evolving LLM Agents
  4. 2026Planner Matters! An Efficient and Unbalanced Multi-agent Collaboration Framework for Long-horizon Planning
  5. 2025MPO: Boosting LLM Agents with Meta Plan Optimization
  6. 2025SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligence
  7. 2026MetaAgent-X : Breaking the Ceiling of Automatic Multi-Agent Systems via End-to-End Reinforcement Learning
  8. 2026UnifiedPlayers: Enhance Tool-Integrated Reasoning in Agentic Reinforcement Learning