Semantic Intelligence: Integrating GPT-4 with A Planning in Low-Cost Robotics
Not on the map. Why?
Abstract (arXiv)
Classical robot navigation often relies on hardcoded state machines and purely geometric path planners, limiting a robot's ability to interpret high-level semantic instructions. In this paper, we first assess GPT-4's ability to act as a path planner compared to the A* algorithm, then present a hybrid planning framework that integrates GPT-4's semantic reasoning with A* on a low-cost robot platform operating on ROS2 Humble. Our approach eliminates explicit finite state machine (FSM) coding by using prompt-based GPT-4 reasoning to handle task logic while maintaining the accurate paths computed by A*. The GPT-4 module provides semantic understanding of instructions and environmental cues (e.g., recognizing toxic obstacles or crowded areas to avoid, or understanding low-battery situations requiring alternate route selection), and dynamically adjusts the robot's occupancy grid via obstacle buffering to enforce semantic constraints. We demonstrate multi-step reasoning for sequential tasks, such as first navigating to a resource goal and then reaching a final destination safely. Experiments on a Petoi Bittle robot with an overhead camera and Raspberry Pi Zero 2W compare classical A* against GPT-4-assisted planning. Results show that while A* is faster and more accurate for basic route generation and obstacle avoidance, the GPT-4-integrated system achieves high success rates (96-100%) on semantic tasks that are infeasible for pure geometric planners. This work highlights how affordable robots can exhibit intelligent, context-aware behaviors by leveraging large language model reasoning with minimal hardware and no fine-tuning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 24 references that are in the map. First posted on arXiv 3 May 2025.
Builds on
21 of 24 references.
References · 21
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2022LM-Nav: Robotic Navigation with Large Pre-Trained Models of Language, Vision, and Actioncited by 439
- 2023ChatGPT for Robotics: Design Principles and Model Abilitiescited by 299
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
- 2023TidyBot: Personalized Robot Assistance with Large Language Modelscited by 221
- 2022CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memorycited by 165
- 2023Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Modelcited by 116
- 2023Prompt a Robot to Walk with Large Language Modelscited by 45
9 more
- 2024LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planningcited by 45
- 2024MC-GPT: Empowering Vision-and-Language Navigation with Memory Map and Reasoning Chainscited by 25
- 2025Safety Aware Task Planning via Large Language Models in Roboticscited by 24
- 2024Empowering Large Language Models on Robotic Manipulation with Affordance Promptingcited by 17
- 2024LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robotscited by 16
- 2024Efficient Sequential Decision Making with Large Language Modelscited by 16
- 2025Robotic Programmer: Video Instructed Policy Code Generation for Robotic Manipulationcited by 11
- 2023Robot Task Planning Based on Large Language Model Representing Knowledge with Directed Graph Structurescited by 7
- 2024A Comparison of Prompt Engineering Techniques for Task Planning and Execution in Service Roboticscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Semantic Risk-Aware Heuristic Planning for Robotic Navigation in Dynamic Environments: An LLM-Inspired Approach
- 2023Learning to Reason over Scene Graphs: A Case Study of Finetuning GPT-2 into a Robot Language Model for Grounded Task Planning
- 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planning
- 2025A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStream
- 2026CoPlanVLM: Coordinated Path Planning for a Robot Team using Vision Language Models
- 2025Don't Just Search, Understand: Semantic Path Planning Agent for Spherical Tensegrity Robots in Unknown Environments
- 2026A Semantic Autonomy Framework for VLM-Integrated Indoor Mobile Robots: Hybrid Deterministic Reasoning and Cross-Robot Adaptive Memory
- 2026Semantic Area Graph Reasoning for Multi-Robot Language-Guided Search