mlsanityData to 14 Oct 2026

An LLM-Explainable DRL Framework for Passenger-Directed Autonomous Driving

arXiv 2606.20640 ↗First posted 2 Jun 2026cs.AI cs.LG math.OCcited by 0

On the map: End-to-end autonomous driving → Large language models for driving

Abstract (arXiv)

Autonomous vehicles offer the potential for safer and more efficient mobility, yet public trust remains limited due to the lack of transparency in their decision-making. This work addresses this issue by combining deep reinforcement learning (DRL) for adaptive driving control with large language model (LLM)-based explainability modules designed to communicate agent behavior to passengers. DRL agents were trained in simulation using a Dueling Double Deep Q-Network to follow distinct driving requests: textitfast, textitcomfort, and textitstop. They demonstrated stable learning, safe compliance with traffic rules, and reliable switching between modes within a single trip. In parallel, LLM modules were introduced to interpret passenger requests, determine when explanations were needed, and generate concise, safety-oriented justifications. Results show that this framework, serving as a proof of concept for integrating RL decision-making and LLMs, balances safety, adaptability, and explainability, and is most effective when requests are delayed or overridden due to safety constraints.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 10 of its 25 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

10 of 25 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Model16 Feb
  2. 2023Personalized Autonomous Driving with Large Language Models: Field Experiments14 Dec
  3. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Models28 Sep

Other references · 7

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  2. 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 721
  3. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 150
  4. 2023Driving through the Concept Gridlock: Unraveling Explainability Bottlenecks in Automated Drivingcited by 9
  5. 2025X-Driver: Explainable Autonomous Driving with Vision-Language Modelscited by 9
  6. 2021Deep Reinforcement Q-Learning for Intelligent Traffic Signal Control with Partial Detectioncited by 4
  7. 2025Multimodal Framework for Explainable Autonomous Driving: Integrating Video, Sensor, and Textual Data for Enhanced Decision-Making and Transparencycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025TeLL-Drive: Enhancing Autonomous Driving with Teacher LLM-Guided Deep Reinforcement Learning
  2. 2024Large Language Model guided Deep Reinforcement Learning for Decision Making in Autonomous Driving
  3. 2023Towards Safe Autonomous Driving Policies using a Neuro-Symbolic Deep Reinforcement Learning Approach
  4. 2024Optimizing Autonomous Driving for Safety: A Human-Centric Approach with LLM-Enhanced RLHF
  5. 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspective
  6. 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning
  7. 2026SARAD: LLM-Based Safety-Aware Hybrid Reinforcement Learning with Collision Prediction for Autonomous Driving
  8. 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving