Human-like Semantic Navigation for Autonomous Driving using Knowledge Representation and Large Language Models
On the map: End-to-end autonomous driving → Large language models for driving
Abstract (arXiv)
Achieving full automation in self-driving vehicles remains a challenge, especially in dynamic urban environments where navigation requires real-time adaptability. Existing systems struggle to handle navigation plans when faced with unpredictable changes in road layouts, spontaneous detours, or missing map data, due to their heavy reliance on predefined cartographic information. In this work, we explore the use of Large Language Models to generate Answer Set Programming rules by translating informal navigation instructions into structured, logic-based reasoning. ASP provides non-monotonic reasoning, allowing autonomous vehicles to adapt to evolving scenarios without relying on predefined maps. We present an experimental evaluation in which LLMs generate ASP constraints that encode real-world urban driving logic into a formal knowledge representation. By automating the translation of informal navigation instructions into logical rules, our method improves adaptability and explainability in autonomous navigation. Results show that LLM-driven ASP rule generation supports semantic-based decision-making, offering an explainable framework for dynamic navigation planning that aligns closely with how humans communicate navigational intent.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 5 of its 17 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
5 of 17 references.
Closest ancestors · 3
Same direction, newest first
- 2024RAG-based Explainable Prediction of Road Users Behaviors for Automated Driving using Knowledge Graphs and Large Language Models1 May
- 2023LaMPilot: An Open Benchmark Dataset for Autonomous Driving with Language Model Programs7 Dec
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving3 Oct
Other references · 2
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Models
- 2023A Language Agent for Autonomous Driving
- 2024Making Large Language Models Better Planners with Reasoning-Decision Alignment
- 2024Tokenize the World into Object-level Knowledge to Address Long-tail Events in Autonomous Driving
- 2025Align2Act: Instruction-Tuned Models for Human-Aligned Autonomous Driving
- 2025Knowledge Integration Strategies in Autonomous Vehicle Prediction and Planning: A Comprehensive Survey
- 2023Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehicles