On the Prospects of Incorporating Large Language Models (LLMs) in Automated Planning and Scheduling (APS)
Not on the map. Why?
Abstract (arXiv)
Automated Planning and Scheduling is among the growing areas in Artificial Intelligence (AI) where mention of LLMs has gained popularity. Based on a comprehensive review of 126 papers, this paper investigates eight categories based on the unique applications of LLMs in addressing various aspects of planning problems: language translation, plan generation, model construction, multi-agent planning, interactive planning, heuristics optimization, tool integration, and brain-inspired planning. For each category, we articulate the issues considered and existing gaps. A critical insight resulting from our review is that the true potential of LLMs unfolds when they are integrated with traditional symbolic planners, pointing towards a promising neuro-symbolic approach. This approach effectively combines the generative aspects of LLMs with the precision of classical planning methods. By synthesizing insights from existing literature, we underline the potential of this integration to address complex planning challenges. Our goal is to encourage the ICAPS community to recognize the complementary strengths of LLMs and symbolic planners, advocating for a direction in automated planning that leverages these synergistic capabilities to develop more advanced and intelligent planning systems.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 67 of its 115 references that are in the map. First posted on arXiv 4 Jan 2024.
Builds on
67 of 115 references.
References · 67
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
- 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Changecited by 372
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
38 more
- 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 298
- 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 291
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2023ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddingscited by 238
- 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 223
- 2023OpenAGI: When LLM Meets Domain Expertscited by 196
- 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
- 2022Open-vocabulary Queryable Scene Representations for Real World Planningcited by 159
- 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 143
- 2023Task and Motion Planning with Large Language Models for Object Rearrangementcited by 140
- 2023LLM-Grounder: Open-Vocabulary 3D Visual Grounding with Large Language Model as an Agentcited by 134
- 2023From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thoughtcited by 118
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 116
- 2023AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkerscited by 111
- 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 107
- 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 104
- 2023Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modellingcited by 88
- 2023Navigation with Large Language Models: Semantic Guesswork as a Heuristic for Planningcited by 88
- 2023On the Planning Abilities of Large Language Models (A Critical Investigation with a Proposed Benchmark)cited by 85
- 2023Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidancecited by 85
- 2023ISR-LLM: Iterative Self-Refined Large Language Model for Long-Horizon Sequential Task Planningcited by 77
- 2023Evaluating Cognitive Maps and Planning in Large Language Models with CogEvalcited by 77
- 2022Parsel: Algorithmic Reasoning with Language Models by Composing Decompositionscited by 62
- 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Textcited by 59
- 2023Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planningcited by 59
- 2023Guiding Language Model Reasoning with Planning Tokenscited by 58
- 2023SayNav: Grounding Large Language Models for Dynamic Planning to Navigation in New Environmentscited by 53
- 2023SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledgecited by 49
- 2023Distilling Script Knowledge from Large Language Models for Constrained Language Planningcited by 45
- 2023Steve-Eye: Equipping LLM-based Embodied Agents with Visual Perception in Open Worldscited by 45
- 2023Multimodal Procedural Planning via Dual Text-Image Promptingcited by 40
- 2023Statler: State-Maintaining Language Models for Embodied Reasoningcited by 40
- 2023Understanding the Capabilities of Large Language Models for Automated Planningcited by 34
- 2023Vision-Language Interpreter for Robot Task Planningcited by 29
- 2023PREFER: Prompt Ensemble Learning via Feedback-Reflect-Refinecited by 28
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2024: 15; 2025: 17; 2026: 8.
40 papers.
Sort:
By area:
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 65
- 2024Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Tracescited by 40
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2024DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Modelscited by 33
- 2024VLMPC: Vision-Language Model Predictive Control for Robotic Manipulationcited by 32
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysiscited by 27
- 2024Octopus: On-device language model for function calling of software APIscited by 26
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 19
- 2024Probabilistically Correct Language-based Multi-Robot Planning using Conformal Predictioncited by 18
- 2024TRIP-PAL: Travel Planning with Guarantees by Combining Large Language Models and Automated Plannerscited by 17
- 2024Planning in the Dark: LLM-Symbolic Planning Pipeline without Expertscited by 15
- 2025LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Roboticscited by 15
28 more
- 2025ConformalNL2LTL: Translating Natural Language Instructions into Temporal Logic Formulas with Conformal Correctness Guaranteescited by 9
- 2025A Roadmap to Guide the Integration of LLMs in Hierarchical Planningcited by 7
- 2025Advancing the Scientific Method with Large Language Models: From Hypothesis to Discoverycited by 7
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Taskscited by 6
- 2024FISHNET: Financial Intelligence from Sub-querying, Harmonizing, Neural-Conditioning, Expert Swarms, and Task Planningcited by 5
- 2024Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairscited by 4
- 2025Vision-Language Model Predictive Control for Manipulation Planning and Trajectory Generationcited by 4
- 2024The Case for Developing a Foundation Model for Planning-like Tasks from Scratchcited by 3
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Explorationcited by 3
- 2024Neurosymbolic AI for Enhancing Instructability in Generative AIcited by 3
- 2024Knowledge Boundary and Persona Dynamic Shape A Better Social Media Agentcited by 2
- 2025Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLMcited by 2
- 2025Learning Hierarchical Domain Models Through Environment-Grounded Interactioncited by 1
- 2025NL2GenSym: Natural Language to Generative Symbolic Rules for SOAR Cognitive Architecture via Large Language Modelscited by 1
- 2026Agentic LLM Planning via Step-Wise PDDL Simulation: An Empirical Characterisationcited by 1
- 2024Automating Transfer of Robot Task Plans using Functorial Data Migrationscited by 0
- 2025MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systemscited by 0
- 2025Model-Based AI planning and Execution Systems for Roboticscited by 0
- 2025Inspire or Predict? Exploring New Paradigms in Assisting Classical Planners with Large Language Modelscited by 0
- 2025Scaling Multi-Agent Epistemic Planning through GNN-Derived Heuristicscited by 0
- 2025Towards a General Framework for HTN Modeling with LLMscited by 0
- 2026Tool-Aware Planning in Contact Center AI: Evaluating LLMs through Lineage-Guided Query Decompositioncited by 0
- 2026Generative AI-assisted Participatory Modeling in Socio-Environmental Planning under Deep Uncertaintycited by 0
- 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planningcited by 0
- 2026Eliot: Interactively underlineExploring Fast-Changing Scientific underlineLiterature Trends with underlineOnline Daunderlineta and Learningcited by 0
- 2026An LLM-Based Assistance System for Intuitive and Flexible Capability-Based Planningcited by 0
- 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planningcited by 0
- 2026Planning with Transformers: Chain of Computation and Structured Context Windowscited by 0
- 2026Planning with Transformers: Chain of Computation and Structured Context Windows20 Jul 2026
- 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planning24 Jun 2026
- 2026An LLM-Based Assistance System for Intuitive and Flexible Capability-Based Planning27 May 2026
- 2026Eliot: Interactively underlineExploring Fast-Changing Scientific underlineLiterature Trends with underlineOnline Daunderlineta and Learning26 May 2026
- 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning4 May 2026
- 2026Generative AI-assisted Participatory Modeling in Socio-Environmental Planning under Deep Uncertainty17 Mar 2026
- 2026Agentic LLM Planning via Step-Wise PDDL Simulation: An Empirical Characterisation6 Mar 2026
- 2026Tool-Aware Planning in Contact Center AI: Evaluating LLMs through Lineage-Guided Query Decomposition16 Feb 2026
- 2025Towards a General Framework for HTN Modeling with LLMs22 Nov 2025
- 2025NL2GenSym: Natural Language to Generative Symbolic Rules for SOAR Cognitive Architecture via Large Language Models10 Oct 2025
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Tasks6 Oct 2025
- 2025Scaling Multi-Agent Epistemic Planning through GNN-Derived Heuristics18 Aug 2025
28 more
- 2025Inspire or Predict? Exploring New Paradigms in Assisting Classical Planners with Large Language Models15 Aug 2025
- 2025Advancing the Scientific Method with Large Language Models: From Hypothesis to Discovery22 May 2025
- 2025Learning Hierarchical Domain Models Through Environment-Grounded Interaction15 May 2025
- 2025Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLM13 May 2025
- 2025Model-Based AI planning and Execution Systems for Robotics7 May 2025
- 2025LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics30 Apr 2025
- 2025MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systems23 Apr 2025
- 2025ConformalNL2LTL: Translating Natural Language Instructions into Temporal Logic Formulas with Conformal Correctness Guarantees22 Apr 2025
- 2025Vision-Language Model Predictive Control for Manipulation Planning and Trajectory Generation7 Apr 2025
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Models22 Mar 2025
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb 2025
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planning25 Feb 2025
- 2025A Roadmap to Guide the Integration of LLMs in Hierarchical Planning14 Jan 2025
- 2024FISHNET: Financial Intelligence from Sub-querying, Harmonizing, Neural-Conditioning, Expert Swarms, and Task Planning25 Oct 2024
- 2024Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces13 Oct 2024
- 2024A Systematic Survey on Large Language Models for Algorithm Design11 Oct 2024
- 2024Planning in the Dark: LLM-Symbolic Planning Pipeline without Experts24 Sep 2024
- 2024Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairs1 Sep 2024
- 2024Neurosymbolic AI for Enhancing Instructability in Generative AI26 Jul 2024
- 2024VLMPC: Vision-Language Model Predictive Control for Robotic Manipulation13 Jul 2024
- 2024Automating Transfer of Robot Task Plans using Functorial Data Migrations22 Jun 2024
- 2024TRIP-PAL: Travel Planning with Guarantees by Combining Large Language Models and Automated Planners14 Jun 2024
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Exploration13 Apr 2024
- 2024The Case for Developing a Foundation Model for Planning-like Tasks from Scratch6 Apr 2024
- 2024DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Models4 Apr 2024
- 2024Octopus: On-device language model for function calling of software APIs2 Apr 2024
- 2024Knowledge Boundary and Persona Dynamic Shape A Better Social Media Agent28 Mar 2024
- 2024Probabilistically Correct Language-based Multi-Robot Planning using Conformal Prediction23 Feb 2024
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysiscited by 27
- 2024Octopus: On-device language model for function calling of software APIscited by 26
- 2025LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Roboticscited by 15
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Taskscited by 6
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Explorationcited by 3
- 2026Agentic LLM Planning via Step-Wise PDDL Simulation: An Empirical Characterisationcited by 1
- 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planningcited by 0
- 2026HEART: Coordination of Heterogeneous Expert Agents for Physically Grounded Robotic Task Planning24 Jun 2026
- 2026Agentic LLM Planning via Step-Wise PDDL Simulation: An Empirical Characterisation6 Mar 2026
- 2025When Should Users Check? Modeling Confirmation Frequency in Multi-Step Agentic AI Tasks6 Oct 2025
- 2025LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics30 Apr 2025
- 2025Why Are Web AI Agents More Vulnerable Than Standalone LLMs? A Security Analysis27 Feb 2025
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Exploration13 Apr 2024
- 2024Octopus: On-device language model for function calling of software APIs2 Apr 2024
- 2024A Systematic Survey on Large Language Models for Algorithm Designcited by 65
- 2025LLMs as Planning Formalizers: A Survey for Leveraging Large Language Models to Construct Automated Planning Modelscited by 38
- 2024DELTA: Decomposed Efficient Long-Term Robot Task Planning using Large Language Modelscited by 33
- 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 19
- 2024Probabilistically Correct Language-based Multi-Robot Planning using Conformal Predictioncited by 18
- 2024TRIP-PAL: Travel Planning with Guarantees by Combining Large Language Models and Automated Plannerscited by 17
- 2024Planning in the Dark: LLM-Symbolic Planning Pipeline without Expertscited by 15
- 2025ConformalNL2LTL: Translating Natural Language Instructions into Temporal Logic Formulas with Conformal Correctness Guaranteescited by 9
- 2025Advancing the Scientific Method with Large Language Models: From Hypothesis to Discoverycited by 7
- 2024FISHNET: Financial Intelligence from Sub-querying, Harmonizing, Neural-Conditioning, Expert Swarms, and Task Planningcited by 5
- 2024Enhancing Source Code Security with LLMs: Demystifying The Challenges and Generating Reliable Repairscited by 4
- 2024The Case for Developing a Foundation Model for Planning-like Tasks from Scratchcited by 3
12 most cited of 29 All 29 (JSON)
- 2026Planning with Transformers: Chain of Computation and Structured Context Windows20 Jul 2026
- 2026An LLM-Based Assistance System for Intuitive and Flexible Capability-Based Planning27 May 2026
- 2026Eliot: Interactively underlineExploring Fast-Changing Scientific underlineLiterature Trends with underlineOnline Daunderlineta and Learning26 May 2026
- 2026U-Define: Designing User Workflows for Hard and Soft Constraints in LLM-Based Planning4 May 2026
- 2026Generative AI-assisted Participatory Modeling in Socio-Environmental Planning under Deep Uncertainty17 Mar 2026
- 2026Tool-Aware Planning in Contact Center AI: Evaluating LLMs through Lineage-Guided Query Decomposition16 Feb 2026
- 2025Towards a General Framework for HTN Modeling with LLMs22 Nov 2025
- 2025NL2GenSym: Natural Language to Generative Symbolic Rules for SOAR Cognitive Architecture via Large Language Models10 Oct 2025
- 2025Scaling Multi-Agent Epistemic Planning through GNN-Derived Heuristics18 Aug 2025
- 2025Inspire or Predict? Exploring New Paradigms in Assisting Classical Planners with Large Language Models15 Aug 2025
- 2025Advancing the Scientific Method with Large Language Models: From Hypothesis to Discovery22 May 2025
- 2025Learning Hierarchical Domain Models Through Environment-Grounded Interaction15 May 2025
12 newest of 29 All 29 (JSON)