Robot Task Planning and Situation Handling in Open Worlds
Not on the map. Why?
Abstract (arXiv)
Automated task planning algorithms have been developed to help robots complete complex tasks that require multiple actions. Most of those algorithms have been developed for "closed worlds" assuming complete world knowledge is provided. However, the real world is generally open, and the robots frequently encounter unforeseen situations that can potentially break the planner's completeness. This paper introduces a novel algorithm (COWP) for open-world task planning and situation handling that dynamically augments the robot's action knowledge with task-oriented common sense. In particular, common sense is extracted from Large Language Models based on the current task at hand and robot skills. For systematic evaluations, we collected a dataset that includes 561 execution-time situations in a dining domain, where each situation corresponds to a state instance of a robot being potentially unable to complete a task using a solution that normally works. Experimental results show that our approach significantly outperforms competitive baselines from the literature in the success rate of service tasks. Additionally, we have demonstrated COWP using a mobile manipulator. The project website is available at: https://cowplanning.github.io/, where a more detailed version can also be found. This version has been accepted for publication in Autonomous Robots.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 19 of its 36 references that are in the map. First posted on arXiv 4 Oct 2022.
Builds on
19 of 36 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2018VirtualHome: Simulating Household Activities via Programscited by 411
- 2021Symbolic Knowledge Distillation: from General Language Models to Commonsense Modelscited by 270
- 2022Pre-Trained Language Models for Interactive Decision-Makingcited by 220
7 more
- 2021Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learnerscited by 115
- 2021Can Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA?cited by 62
- 2019Online Replanning in Belief Space for Partially Observable Task and Motion Problemscited by 60
- 2022Housekeep: Tidying Virtual Households using Commonsense Reasoningcited by 57
- 2018Task Planning in Robotics: an Empirical Comparison of PDDL-based and ASP-based Systemscited by 40
- 2020Leveraging Post Hoc Context for Faster Learning in Bandit Settings with Applications in Robot-Assisted Feedingcited by 11
- 2019Augmenting Knowledge through Statistical, Goal-oriented Human-Robot Dialogcited by 5
Built on by
Citing papers per year: 2023: 4; 2024: 3; 2025: 1; 2026: 2.
10 papers.
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
- 2023GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstrationcited by 76
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2023Grounding Classical Task Planners via Vision-Language Modelscited by 23
- 2024Towards Open-World Grasping with Large Vision-Language Modelscited by 13
- 2024NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worldscited by 4
- 2025AdaptBot: Combining LLM with Knowledge Graphs and Human Input for Generic-to-Specific Task Decomposition and Knowledge Refinementcited by 3
- 2024A Prompt-driven Task Planning Method for Multi-drones based on Large Language Modelcited by 1
- 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skillscited by 0
- 2026Bridging Learned Visual Perception and Symbolic Belief-Space Planningcited by 0
- 2026Bridging Learned Visual Perception and Symbolic Belief-Space Planning15 Sep 2026
- 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skills3 Aug 2026
- 2025AdaptBot: Combining LLM with Knowledge Graphs and Human Input for Generic-to-Specific Task Decomposition and Knowledge Refinement4 Feb 2025
- 2024Towards Open-World Grasping with Large Vision-Language Models26 Jun 2024
- 2024A Prompt-driven Task Planning Method for Multi-drones based on Large Language Model14 May 2024
- 2024NovelGym: A Flexible Ecosystem for Hybrid Planning and Learning Agents Designed for Open Worlds7 Jan 2024
- 2023GPT-4V(ision) for Robotics: Multimodal Task Planning from Human Demonstration20 Nov 2023
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiency22 Apr 2023
- 2023Grounding Classical Task Planners via Vision-Language Models17 Apr 2023
- 2023Benchmarks for Automated Commonsense Reasoning: A Survey9 Feb 2023