Large Language Model based Interactive Decision-Making for Autonomous Driving
On the map: End-to-end autonomous driving → Large language models for driving
Abstract (arXiv)
In high-conflict mixed-traffic scenarios involving human-driven and autonomous vehicles, most existing autonomous driving systems default to overly conservative behaviors, lack proactive interaction, and consequently suffer from limited public acceptance. To mitigate intent misunderstandings and decision failures, we present a Large Language Model based interactive decision-making framework that augments scene understanding and intent-aware interaction to jointly improve safety and efficiency. The approach uses Object-Process Methodology to semantically model complex multi-vehicle scenes, abstracting low-level perceptual data into objects, processes, and relations, thereby streamlining reasoning over latent causal structure. Building on this representation, the Large Language Model parses both explicit and implicit intents of surrounding agents and, under jointly enforced safety and efficiency constraints, selects candidate maneuvers. We further generate perturbed trajectory candidates via Monte Carlo sampling and evaluate them to obtain an optimized executable trajectory. To foster transparency and coordination with nearby road users, the final decision is translated by the Large Language Model into concise natural-language messages and broadcast through an external Human-Machine Interface, completing a closed loop from scene understanding to action to language. Experiments in a cluster driving simulator demonstrate that the proposed method outperforms traditional baselines across safety, comfort, and efficiency metrics, while a Turing-test-style evaluation indicates a high degree of human-likeness in decision making. Besides, these results suggest that coupling semantic scene abstraction with Large Language Model mediated intent reasoning and language-based eHMI communication offers a practical pathway toward interactive, trustworthy autonomous driving in dense mixed traffic.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 7 of its 38 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
7 of 38 references.
Closest ancestors · 3
Same direction, newest first
- 2023LLM4Drive: A Survey of Large Language Models for Autonomous Driving2 Nov
- 2023Receive, Reason, and React: Drive as You Say with Large Language Models in Autonomous Vehicles12 Oct
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Model2 Oct
Other references · 4
- 2024Cooperative Decision-Making for CAVs at Unsignalized Intersections: A MARL Approach with Attention and Hierarchical Game Priorscited by 14
- 2018Adaptive Game-Theoretic Decision Making for Autonomous Vehicle Control at Roundaboutscited by 11
- 2019Cooperative Driving at Unsignalized Intersections Using Tree Searchcited by 10
- 2022Decision Making for Connected Automated Vehicles at Urban Intersections Considering Social and Individual Benefitscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Driving
- 2023Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehicles
- 2024Text-to-Drive: Diverse Driving Behavior Synthesis via Large Language Models
- 2024Making Large Language Models Better Planners with Reasoning-Decision Alignment
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Models
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
- 2025Case-based Reasoning Augmented Large Language Model Framework for Decision Making in Realistic Safety-Critical Driving Scenarios
- 2026Decision-Making with Lightweight Confidence-Aware Language Model for Autonomous Driving