LLM A*: Human in the Loop Large Language Models Enabled A* Search for Robotics
Not on the map. Why?
Abstract (arXiv)
This research focuses on how Large Language Models (LLMs) can help with (path) planning for mobile embodied agents such as robots, in a human-in-the-loop and interactive manner. A novel framework named LLM A*, aims to leverage the commonsense of LLMs, and the utility-optimal A* is proposed to facilitate few-shot near-optimal path planning. Prompts are used for two main purposes: 1) to provide LLMs with essential information like environments, costs, heuristics, etc.; 2) to communicate human feedback on intermediate planning results to LLMs. This approach takes human feedback on board and renders the entire planning process transparent (akin to a `white box') to humans. Moreover, it facilitates code-free path planning, thereby fostering the accessibility and inclusiveness of artificial intelligence techniques to communities less proficient in coding. Comparative analysis against A* and RL demonstrates that LLM A* exhibits greater efficiency in terms of search space and achieves paths comparable to A* while outperforming RL. The interactive nature of LLM A* also makes it a promising tool for deployment in collaborative human-robot tasks. Codes and Supplemental Materials can be found at GitHub: https://github.com/speedhawk/LLM-A-.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). Builds on 11 of its 18 references that are in the map. First posted on arXiv 4 Dec 2023.
Builds on
11 of 18 references.
References · 11
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2015Trust Region Policy Optimizationcited by 2,580
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2022LLM-Planner: Few-Shot Grounded Planning for Embodied Agents with Large Language Modelscited by 462
- 2020Path Planning using Neural A* Searchcited by 52
- 2023Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoningcited by 49
- 2023Language-Conditioned Path Planningcited by 10
- 2022A Human-friendly Verbal Communication Platform for Multi-Robot Systems: Design and Principlescited by 2
- 2022Fast-Spanning Ant Colony Optimisation (FaSACO) for Mobile Robot Coverage Path Planningcited by 1
- 2023Hybrid of representation learning and reinforcement learning for dynamic and complex robotic motion planningcited by 1
Built on by
Citing papers per year: 2024: 11; 2025: 13; 2026: 2.
26 papers.
Sort:
By area:
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 57
- 2024AGILE: A Novel Reinforcement Learning Framework of LLM Agentscited by 45
- 2024Agent-Oriented Planning in Multi-Agent Systemscited by 36
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 29
- 2024Planning with Multi-Constraints via Collaborative Language Agentscited by 26
- 2025Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidancecited by 14
- 2025LLM-based Automated Grading with Human-in-the-Loopcited by 13
- 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Modelscited by 12
- 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impactscited by 10
14 more
- 2025Exploring the Necessity of Reasoning in LLM-based Agent Scenarioscited by 10
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomycited by 9
- 2024Look Further Ahead: Testing the Limits of GPT-4 in Path Planningcited by 7
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunitiescited by 6
- 2025LLMAP: LLM-Assisted Multi-Objective Route Planning with User Preferencescited by 5
- 2025How Far are LLMs from Real Search? A Comprehensive Study on Efficiency, Completeness, and Inherent Capabilitiescited by 4
- 2026MINT: Minimal Information Neuro-Symbolic Tree for Objective-Driven Knowledge-Gap Reasoning and Active Elicitationcited by 4
- 2025Constraint-Aware Route Recommendation from Natural Language via Hierarchical LLM Agentscited by 3
- 2025Strategy-Augmented Planning for Large Language Models via Opponent Exploitationcited by 2
- 2025Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Researchcited by 2
- 2025DINOv3-Diffusion Policy: Self-Supervised Large Visual Model for Visuomotor Diffusion Policy Learningcited by 2
- 2026Overcoming the Weakest-Link Effect in LLM-Driven Program Optimization via Heterogeneous Edit Recombinationcited by 2
- 2024Agentic AI: The Era of Semantic Decodingcited by 1
- 2025Deployability-Centric Infrastructure-as-Code Generation: Fail, Learn, Refine, and Succeed through LLM-Empowered DevOps Simulationcited by 1
- 2026Overcoming the Weakest-Link Effect in LLM-Driven Program Optimization via Heterogeneous Edit Recombination31 Jul 2026
- 2026MINT: Minimal Information Neuro-Symbolic Tree for Objective-Driven Knowledge-Gap Reasoning and Active Elicitation4 Feb 2026
- 2025Constraint-Aware Route Recommendation from Natural Language via Hierarchical LLM Agents7 Oct 2025
- 2025DINOv3-Diffusion Policy: Self-Supervised Large Visual Model for Visuomotor Diffusion Policy Learning22 Sep 2025
- 2025LLMAP: LLM-Assisted Multi-Objective Route Planning with User Preferences14 Sep 2025
- 2025Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidance23 Jul 2025
- 2025Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Research14 Jun 2025
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomy11 Jun 2025
- 2025Deployability-Centric Infrastructure-as-Code Generation: Fail, Learn, Refine, and Succeed through LLM-Empowered DevOps Simulation5 Jun 2025
- 2025Strategy-Augmented Planning for Large Language Models via Opponent Exploitation13 May 2025
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey1 May 2025
- 2025LLM-based Automated Grading with Human-in-the-Loop7 Apr 2025
14 more
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
- 2025Exploring the Necessity of Reasoning in LLM-based Agent Scenarios14 Mar 2025
- 2025How Far are LLMs from Real Search? A Comprehensive Study on Efficiency, Completeness, and Inherent Capabilities25 Feb 2025
- 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impacts11 Oct 2024
- 2024Agent-Oriented Planning in Multi-Agent Systems3 Oct 2024
- 2024Human-In-The-Loop Machine Learning for Safe and Ethical Autonomous Vehicles: Principles, Challenges, and Opportunities22 Aug 2024
- 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun 2024
- 2024Look Further Ahead: Testing the Limits of GPT-4 in Path Planning17 Jun 2024
- 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Models28 May 2024
- 2024Planning with Multi-Constraints via Collaborative Language Agents26 May 2024
- 2024AGILE: A Novel Reinforcement Learning Framework of LLM Agents23 May 2024
- 2024Agentic AI: The Era of Semantic Decoding21 Mar 2024
- 2024Understanding the planning of LLM agents: A survey5 Feb 2024
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model4 Jan 2024
- 2024Understanding the planning of LLM agents: A surveycited by 421
- 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 99
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 57
- 2024AGILE: A Novel Reinforcement Learning Framework of LLM Agentscited by 45
- 2024Agent-Oriented Planning in Multi-Agent Systemscited by 36
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Surveycited by 29
- 2024Planning with Multi-Constraints via Collaborative Language Agentscited by 26
- 2025Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidancecited by 14
- 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impactscited by 10
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomycited by 9
- 2025Constraint-Aware Route Recommendation from Natural Language via Hierarchical LLM Agentscited by 3
- 2024Agentic AI: The Era of Semantic Decodingcited by 1
- 2025Constraint-Aware Route Recommendation from Natural Language via Hierarchical LLM Agents7 Oct 2025
- 2025Enabling Self-Improving Agents to Learn at Test Time With Human-In-The-Loop Guidance23 Jul 2025
- 2025A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomy11 Jun 2025
- 2025LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey1 May 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
- 2024From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impacts11 Oct 2024
- 2024Agent-Oriented Planning in Multi-Agent Systems3 Oct 2024
- 2024A Review of Large Language Models and Autonomous Agents in Chemistry26 Jun 2024
- 2024Planning with Multi-Constraints via Collaborative Language Agents26 May 2024
- 2024AGILE: A Novel Reinforcement Learning Framework of LLM Agents23 May 2024
- 2024Agentic AI: The Era of Semantic Decoding21 Mar 2024
- 2024Understanding the planning of LLM agents: A survey5 Feb 2024
- 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Modelscited by 12
- 2025Exploring the Necessity of Reasoning in LLM-based Agent Scenarioscited by 10
- 2026MINT: Minimal Information Neuro-Symbolic Tree for Objective-Driven Knowledge-Gap Reasoning and Active Elicitationcited by 4
- 2026MINT: Minimal Information Neuro-Symbolic Tree for Objective-Driven Knowledge-Gap Reasoning and Active Elicitation4 Feb 2026
- 2025Exploring the Necessity of Reasoning in LLM-based Agent Scenarios14 Mar 2025
- 2024A Human-Like Reasoning Framework for Multi-Phases Planning Task with Large Language Models28 May 2024
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 268
- 2025LLM-based Automated Grading with Human-in-the-Loopcited by 13
- 2024Look Further Ahead: Testing the Limits of GPT-4 in Path Planningcited by 7
- 2025LLMAP: LLM-Assisted Multi-Objective Route Planning with User Preferencescited by 5
- 2025How Far are LLMs from Real Search? A Comprehensive Study on Efficiency, Completeness, and Inherent Capabilitiescited by 4
- 2025Strategy-Augmented Planning for Large Language Models via Opponent Exploitationcited by 2
- 2025Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Researchcited by 2
- 2026Overcoming the Weakest-Link Effect in LLM-Driven Program Optimization via Heterogeneous Edit Recombinationcited by 2
- 2025Deployability-Centric Infrastructure-as-Code Generation: Fail, Learn, Refine, and Succeed through LLM-Empowered DevOps Simulationcited by 1
- 2026Overcoming the Weakest-Link Effect in LLM-Driven Program Optimization via Heterogeneous Edit Recombination31 Jul 2026
- 2025LLMAP: LLM-Assisted Multi-Objective Route Planning with User Preferences14 Sep 2025
- 2025Perspective on Utilizing Foundation Models for Laboratory Automation in Materials Research14 Jun 2025
- 2025Deployability-Centric Infrastructure-as-Code Generation: Fail, Learn, Refine, and Succeed through LLM-Empowered DevOps Simulation5 Jun 2025
- 2025Strategy-Augmented Planning for Large Language Models via Opponent Exploitation13 May 2025
- 2025LLM-based Automated Grading with Human-in-the-Loop7 Apr 2025
- 2025How Far are LLMs from Real Search? A Comprehensive Study on Efficiency, Completeness, and Inherent Capabilities25 Feb 2025
- 2024Look Further Ahead: Testing the Limits of GPT-4 in Path Planning17 Jun 2024
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Model4 Jan 2024