mlsanityData to 14 Oct 2026

Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Robotics

arXiv 2505.01931 ↗First posted 3 May 2025cs.RO cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Classical robot navigation often relies on hardcoded state machines and purely geometric path planners, limiting a robot's ability to interpret high-level semantic instructions. In this paper, we first assess GPT-4's ability to act as a path planner compared to the A* algorithm, then present a hybrid planning framework that integrates GPT-4's semantic reasoning with A* on a low-cost robot platform operating on ROS2 Humble. Our approach eliminates explicit finite state machine (FSM) coding by using prompt-based GPT-4 reasoning to handle task logic while maintaining the accurate paths computed by A*. The GPT-4 module provides semantic understanding of instructions and environmental cues (e.g., recognizing toxic obstacles or crowded areas to avoid, or understanding low-battery situations requiring alternate route selection), and dynamically adjusts the robot's occupancy grid via obstacle buffering to enforce semantic constraints. We demonstrate multi-step reasoning for sequential tasks, such as first navigating to a resource goal and then reaching a final destination safely. Experiments on a Petoi Bittle robot with an overhead camera and Raspberry Pi Zero 2W compare classical A* against GPT-4-assisted planning. Results show that while A* is faster and more accurate for basic route generation and obstacle avoidance, the GPT-4-integrated system achieves high success rates (96-100%) on semantic tasks that are infeasible for pure geometric planners. This work highlights how affordable robots can exhibit intelligent, context-aware behaviors by leveraging large language model reasoning with minimal hardware and no fine-tuning.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 24 references that are in the map. First posted on arXiv 3 May 2025.

Builds on

21 of 24 references.

References · 21

  1. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  2. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  3. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  4. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  5. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
  6. 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
  7. 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 299
  8. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
  9. 2023TidyBot: Personalized Robot Assistance with Large Language Modelscited by 221
  10. 2022CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memorycited by 165
  11. 2023Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Modelcited by 116
  12. 2023Prompt a Robot to Walk with Large Language Modelscited by 45
9 more
  1. 2024LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planningcited by 45
  2. 2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chainscited by 25
  3. 2025Safety Aware Task Planning via Large Language Models in Roboticscited by 24
  4. 2024Empowering Large Language Models on Robotic Manipulation with Affordance Promptingcited by 17
  5. 2024LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robotscited by 16
  6. 2024Efficient Sequential Decision Making with Large Language Modelscited by 16
  7. 2025Robotic Programmer: Video Instructed Policy Code Generation for Robotic Manipulationcited by 11
  8. 2023Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structurescited by 7
  9. 2024A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Roboticscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Semantic Risk-Aware Heuristic Planning for Robotic Navigation in Dynamic Environments: An LLM-Inspired Approach
  2. 2023Learning to Reason over Scene Graphs: A Case Study of Finetuning GPT-2 into a Robot Language Model for Grounded Task Planning
  3. 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning
  4. 2025A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStream
  5. 2026CoPlanVLM: Coordinated Path Planning for a Robot Team using Vision Language Models
  6. 2025Don't Just Search, Understand: Semantic Path Planning Agent for Spherical Tensegrity Robots in Unknown Environments
  7. 2026A Semantic Autonomy Framework for VLM-Integrated Indoor Mobile Robots: Hybrid Deterministic Reasoning and Cross-Robot Adaptive Memory
  8. 2026Semantic Area Graph Reasoning for Multi-Robot Language-Guided Search