LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robots
Not on the map. Why?
Abstract (arXiv)
The development of a general purpose service robot for daily life necessitates the robot's ability to deploy a myriad of fundamental behaviors judiciously. Recent advancements in training Large Language Models (LLMs) can be used to generate action sequences directly, given an instruction in natural language with no additional domain information. However, while the outputs of LLMs are semantically correct, the generated task plans may not accurately map to acceptable actions and might encompass various linguistic ambiguities. LLM hallucinations pose another challenge for robot task planning, which results in content that is inconsistent with real-world facts or user inputs. In this paper, we propose a task planning method based on a constrained LLM prompt scheme, which can generate an executable action sequence from a command. An exceptional handling module is further proposed to deal with LLM hallucinations problem. This module can ensure the LLM-generated results are admissible in the current environment. We evaluate our method on the commands generated by the RoboCup@Home Command Generator, observing that the robot demonstrates exceptional performance in both comprehending instructions and executing tasks.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 May 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 4; 2025: 9; 2026: 3.
16 papers.
Sort:
By area:
- 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approachescited by 18
- 2025Large Language Model Based Multi-Agent System Augmented Complex Event Processing Pipeline for Internet of Multimedia Thingscited by 8
- 2024Safety Control of Service Robots with LLMs and Embodied Knowledge Graphscited by 7
- 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specificationscited by 4
- 2025RoboReflect: A Robotic Reflective Reasoning Framework for Grasping Ambiguous-Condition Objectscited by 4
- 2024Revolutionizing Bridge Operation and Maintenance with LLM-based Agents: An Overview of Applications and Insightscited by 3
- 2026VASO: Formally Verifiable Self-Evolving Skills for Physical AI Agentscited by 3
- 2025AURA: Autonomous Upskilling with Retrieval-Augmented Agentscited by 2
- 2024Pairing Analogy-Augmented Generation with Procedural Memory for Procedural Q&Acited by 1
- 2025Language-Guided Object Search in Agricultural Environmentscited by 1
- 2025Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Roboticscited by 1
- 2025General-Purpose Robotic Navigation via LVLM-Orchestrated Perception, Reasoning, and Actingcited by 1
4 more
- 2025PASG: A Closed-Loop Framework for Automated Geometric Primitive Extraction and Semantic Anchoring in Robotic Manipulationcited by 1
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Modelscited by 1
- 2026Secure Forgetting: A Framework for Privacy-Driven Unlearning in Large Language Model (LLM)-Based Agentscited by 1
- 2026Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systemscited by 0
- 2026VASO: Formally Verifiable Self-Evolving Skills for Physical AI Agents3 Jun 2026
- 2026Secure Forgetting: A Framework for Privacy-Driven Unlearning in Large Language Model (LLM)-Based Agents1 Apr 2026
- 2026Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systems20 Jan 2026
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Models9 Dec 2025
- 2025PASG: A Closed-Loop Framework for Automated Geometric Primitive Extraction and Semantic Anchoring in Robotic Manipulation8 Aug 2025
- 2025General-Purpose Robotic Navigation via LVLM-Orchestrated Perception, Reasoning, and Acting20 Jun 2025
- 2025AURA: Autonomous Upskilling with Retrieval-Augmented Agents3 Jun 2025
- 2025Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Robotics3 May 2025
- 2025Language-Guided Object Search in Agricultural Environments3 Mar 2025
- 2025RoboReflect: A Robotic Reflective Reasoning Framework for Grasping Ambiguous-Condition Objects16 Jan 2025
- 2025Large language models for artificial general intelligence (AGI): A survey of foundational principles and approaches6 Jan 2025
- 2025Large Language Model Based Multi-Agent System Augmented Complex Event Processing Pipeline for Internet of Multimedia Things1 Jan 2025
4 more
- 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specifications14 Sep 2024
- 2024Pairing Analogy-Augmented Generation with Procedural Memory for Procedural Q&A2 Sep 2024
- 2024Revolutionizing Bridge Operation and Maintenance with LLM-based Agents: An Overview of Applications and Insights14 Jul 2024
- 2024Safety Control of Service Robots with LLMs and Embodied Knowledge Graphs28 May 2024
- 2025Large Language Model Based Multi-Agent System Augmented Complex Event Processing Pipeline for Internet of Multimedia Thingscited by 8
- 2024Revolutionizing Bridge Operation and Maintenance with LLM-based Agents: An Overview of Applications and Insightscited by 3
- 2026VASO: Formally Verifiable Self-Evolving Skills for Physical AI Agentscited by 3
- 2026Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systemscited by 0
- 2026VASO: Formally Verifiable Self-Evolving Skills for Physical AI Agents3 Jun 2026
- 2026Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systems20 Jan 2026
- 2025Large Language Model Based Multi-Agent System Augmented Complex Event Processing Pipeline for Internet of Multimedia Things1 Jan 2025
- 2024Revolutionizing Bridge Operation and Maintenance with LLM-based Agents: An Overview of Applications and Insights14 Jul 2024
- 2025RoboReflect: A Robotic Reflective Reasoning Framework for Grasping Ambiguous-Condition Objectscited by 4
- 2025General-Purpose Robotic Navigation via LVLM-Orchestrated Perception, Reasoning, and Actingcited by 1
- 2026Secure Forgetting: A Framework for Privacy-Driven Unlearning in Large Language Model (LLM)-Based Agentscited by 1
- 2026Secure Forgetting: A Framework for Privacy-Driven Unlearning in Large Language Model (LLM)-Based Agents1 Apr 2026
- 2025General-Purpose Robotic Navigation via LVLM-Orchestrated Perception, Reasoning, and Acting20 Jun 2025
- 2025RoboReflect: A Robotic Reflective Reasoning Framework for Grasping Ambiguous-Condition Objects16 Jan 2025
- 2024Safety Control of Service Robots with LLMs and Embodied Knowledge Graphscited by 7
- 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specificationscited by 4
- 2024Pairing Analogy-Augmented Generation with Procedural Memory for Procedural Q&Acited by 1
- 2025Language-Guided Object Search in Agricultural Environmentscited by 1
- 2025Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Roboticscited by 1
- 2025PASG: A Closed-Loop Framework for Automated Geometric Primitive Extraction and Semantic Anchoring in Robotic Manipulationcited by 1
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Modelscited by 1
- 2025Chat with UAV -- Human-UAV Interaction Based on Large Language Models9 Dec 2025
- 2025PASG: A Closed-Loop Framework for Automated Geometric Primitive Extraction and Semantic Anchoring in Robotic Manipulation8 Aug 2025
- 2025Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Robotics3 May 2025
- 2025Language-Guided Object Search in Agricultural Environments3 Mar 2025
- 2024VernaCopter: Disambiguated Natural-Language-Driven Robot via Formal Specifications14 Sep 2024
- 2024Pairing Analogy-Augmented Generation with Procedural Memory for Procedural Q&A2 Sep 2024
- 2024Safety Control of Service Robots with LLMs and Embodied Knowledge Graphs28 May 2024