mlsanityData to 7 Oct 2026

Large Language Models for Planning: A Comprehensive and Systematic Survey

arXiv 2505.19683 ↗First posted 26 May 2025cs.AI cs.CLcited by 38

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Planning represents a fundamental capability of intelligent agents, requiring comprehensive environmental understanding, rigorous logical reasoning, and effective sequential decision-making. While Large Language Models (LLMs) have demonstrated remarkable performance on certain planning tasks, their broader application in this domain warrants systematic investigation. This paper presents a comprehensive review of LLM-based planning. Specifically, this survey is structured as follows: First, we establish the theoretical foundations by introducing essential definitions and categories about automated planning. Next, we provide a detailed taxonomy and analysis of contemporary LLM-based planning methodologies, categorizing them into three principal approaches: 1) External Module Augmented Methods that combine LLMs with additional components for planning, 2) Finetuning-based Methods that involve using trajectory data and feedback signals to adjust LLMs in order to improve their planning abilities, and 3) Searching-based Methods that break down complex tasks into simpler components, navigate the planning space, or enhance decoding strategies to find the best solutions. Subsequently, we systematically summarize existing evaluation frameworks, including benchmark datasets, evaluation metrics and performance comparisons between representative planning methods. Finally, we discuss the underlying mechanisms enabling LLM-based planning and outline promising research directions for this rapidly evolving field. We hope this survey will serve as a valuable resource to inspire innovation and drive progress in this field.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 240 of its 308 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

240 of 308 references.

Closest ancestors · 19

Same direction, newest first

  1. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMs15 Apr
  2. 2025OpenCodeReasoning: Advancing Data Distillation for Competitive Coding2 Apr
  3. 2025Flow-of-Options: Diversified and Improved LLM Reasoning by Thinking Through Options18 Feb
  4. 2025Boost, Disentangle, and Customize: A Robust System2-to-System1 Pipeline for Code Generation18 Feb
  5. 2025Scaling Autonomous Agents via Automatic Reward Modeling And Planning17 Feb
  6. 2025QLASS: Boosting Language Agent Inference via Q-Guided Stepwise Search4 Feb
  7. 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training20 Jan
  8. 2024CAMPHOR: Collaborative Agents for Multi-input Planning and High-Order Reasoning On Device12 Oct
  9. 2024AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation1 Aug
  10. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  11. 2024Self-playing Adversarial Language Game Enhances LLM Reasoning16 Apr
  12. 2023ADaPT: As-Needed Decomposition and Planning with Language Models8 Nov
7 more
  1. 2023Tree-Planner: Efficient Close-loop Task Planning with Large Language Models12 Oct
  2. 2023Put Your Money Where Your Mouth Is: Evaluating Strategic Planning and Execution of LLM Agents in an Auction Arena9 Oct
  3. 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models6 Oct
  4. 2023Reasoning with Language Model is Planning with World Model24 May
  5. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planning23 May
  6. 2023On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)13 Feb
  7. 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change21 Jun

Other references · 221

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  7. 2025Qwen2.5-VL Technical Reportcited by 5,418
  8. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2023Let's Verify Step by Stepcited by 3,598
  11. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  12. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
38 more
  1. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  2. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  3. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  4. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  5. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  6. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  7. 2018World Modelscited by 1,444
  8. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  9. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  10. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  11. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  12. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,197
  13. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  14. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  15. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  16. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  17. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  18. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  19. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  20. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  21. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
  22. 2023CogAgent: A Visual Language Model for GUI Agentscited by 692
  23. 2014Neural Turing Machinescited by 630
  24. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 574
  25. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
  26. 2024Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Modelscited by 552
  27. 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
  28. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  29. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  30. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
  31. 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
  32. 2024Understanding the planning of LLM agents: A surveycited by 414
  33. 2018VirtualHome: Simulating Household Activities via Programscited by 411
  34. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
  35. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
  36. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 385
  37. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
  38. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359

50 most cited of 221 All 221 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 13; 2026: 25.

38 papers.

Sort:

By area:

  1. 2025A Survey of Context Engineering for Large Language Modelscited by 120
  2. 2025LLM-based Agents Suffer from Hallucinations: A Survey of Taxonomy, Methods, and Directionscited by 49
  3. 2025Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspectivecited by 28
  4. 2026Scalable Power Sampling: Unlocking Efficient, Training-Free Reasoning for LLMs via Distribution Sharpeningcited by 27
  5. 2025VerifyBench: A Systematic Benchmark for Evaluating Reasoning Verifiers Across Domainscited by 22
  6. 2025Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agentscited by 19
  7. 2026Agentic World Modeling: Foundations, Capabilities, Laws, and Beyondcited by 10
  8. 2026JIT-Agent: Scaling Harness Intelligence via Just-in-Time Harness Evolutioncited by 10
  9. 2025CausalStep: A Benchmark for Explicit Stepwise Causal Reasoning in Videoscited by 9
  10. 2025Look Less, Reason More: Rollout-Guided Adaptive Pixel-Space Reasoningcited by 9
  11. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  12. 2026Diversity Collapse in Multi-Agent LLM Systems: Structural Coupling and Collective Failure in Open-Ended Idea Generationcited by 7
26 more
  1. 2025Beyond Policy Optimization: A Data Curation Flywheel for Sparse-Reward Long-Horizon Planningcited by 4
  2. 2025Select Less, Reason More: Prioritizing Evidence Purity for Video Reasoningcited by 4
  3. 2025Automated Penetration Testing with LLM Agents and Classical Planningcited by 4
  4. 2026SING: Synthetic Intention Graph for Scalable Active Tool Discovery in LLM Agentscited by 4
  5. 2026Empowering GUI Agents via Autonomous Experience Exploration and Hindsight Experience Utilization for Task Planningcited by 4
  6. 2025Towards Fully Automated Molecular Simulations: Multi-Agent Framework for Simulation Setup and Force Field Extractioncited by 3
  7. 2026Beyond Accuracy: Evaluating Grounded Visual Evidence in Thinking with Imagescited by 3
  8. 2026Learning Abstractions for Hierarchical Planning in Program-Synthesis Agentscited by 3
  9. 2026The Physics of Multi-Turn Long-Horizon Planning: From Pre-training to Post-training via Single- and Multi-Teacher On-Policy Agentic Distillationcited by 3
  10. 2026MagicAgent: Towards Generalized Agent Planningcited by 2
  11. 2026SafeGen-LLM: Enhancing Safety Generalization in Task Planning for Robotic Systemscited by 2
  12. 2026DocArena: Turning Raw Documents into Controllable Training Environments for Document Search Agentscited by 2
  13. 2026MathMixup: Boosting LLM Mathematical Reasoning with Difficulty-Controllable Data Synthesis and Curriculum Learningcited by 1
  14. 2026STEMVerse: A Dual-Axis Diagnostic Framework for STEM Reasoning in Large Language Modelscited by 1
  15. 2026TodoEvolve: Learning to Architect Agent Planning Systemscited by 1
  16. 2026Information-seeking failures of large language models in agentic clinical reasoningcited by 1
  17. 2025HyPlan: Hybrid Learning-Assisted Planning Under Uncertainty for Safe Autonomous Drivingcited by 0
  18. 2025Co-TAP: Three-Layer Agent Interaction Protocol Technical Reportcited by 0
  19. 2026MMP-A*: Multimodal Perception Enhanced Incremental Heuristic Search on Path Planningcited by 0
  20. 2026Agentic AI for Self-Driving Laboratories in Soft Matter: Taxonomy, Benchmarks,and Open Challengescited by 0
  21. 2026Tool-Aware Planning in Contact Center AI: Evaluating LLMs through Lineage-Guided Query Decompositioncited by 0
  22. 2026From Coarse to Fine: Self-Adaptive Hierarchical Planning for LLM Agentscited by 0
  23. 2026SMART: A Machine Learning and Monte Carlo Framework for Rapid Analysis of Stochastic Transistor Aging and Process Variation in Digital Circuitscited by 0
  24. 2026Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automationcited by 0
  25. 2026Which LLM is Best for Translating Natural Language Goals to PDDLcited by 0
  26. 2026GRASP: Generating, Revising, and Assessing for Strategic Planning with Agentic AIcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Query-Efficient Planning with Language Models
  2. 2025Can LLM-Reasoning Models Replace Classical Planning? A Benchmark Study
  3. 2025LLMs Can Plan Only If We Tell Them
  4. 2025Language Model as Planner and Formalizer under Constraints
  5. 2025A Roadmap to Guide the Integration of LLMs in Hierarchical Planning
  6. 2024Exploring and Benchmarking the Planning Capabilities of Large Language Models
  7. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges
  8. 2025AuDeRe: Automated Strategy Decision and Realization in Robot Planning and Control via LLMs