mlsanityData to 14 Oct 2026

Causal Scene Narration with Runtime Safety Supervision for Vision-Language-Action Driving

arXiv 2604.01723 ↗First posted 2 Apr 2026cs.RO cs.AIcited by 5

On the map: Vision-language-action models → VLA for autonomous driving

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) models for autonomous driving must integrate diverse textual inputs, including navigation commands, hazard warnings, and traffic state descriptions, yet current systems often present these as disconnected fragments, forcing the model to discover on its own which environmental constraints are relevant to the current maneuver. We introduce Causal Scene Narration (CSN), which restructures VLA text inputs through intent-constraint alignment, quantitative grounding, and structured separation, at inference time with zero GPU cost. We complement CSN with Simplex-based runtime safety supervision and training-time alignment via Plackett-Luce DPO with negative log-likelihood (NLL) regularization. A multi-town closed-loop CARLA evaluation shows that CSN improves Driving Score by +31.1% on original LMDrive and +24.5% on the preference-aligned variant. A controlled ablation reveals that causal structure accounts for 39.1% of this gain, with the remainder attributable to information content alone. A perception noise ablation confirms that CSN's benefit is robust to realistic sensing errors. Semantic safety supervision improves Infraction Score, while reactive Time-To-Collision monitoring degrades performance, demonstrating that intent-aware monitoring is needed for VLA systems.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in VLA for autonomous driving, one of 13 directions in Vision-language-action models. Builds on 26 of its 31 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

26 of 31 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026SteerVLA: Steering Vision-Language-Action Models in Long-Tail Driving Scenarios9 Feb

Other references · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  7. 2022Planning-oriented Autonomous Drivingcited by 1,087
  8. 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
  9. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  10. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  11. 2017Safe Reinforcement Learning via Shieldingcited by 449
  12. 2019Control Barrier Functions: Theory and Applicationscited by 372
13 more
  1. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  2. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
  3. 2024Bench2Drive: Towards Multi-Ability Benchmarking of Closed-Loop End-To-End Autonomous Drivingcited by 252
  4. 2022Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baselinecited by 248
  5. 2024Iterative Reasoning Preference Optimizationcited by 246
  6. 2025SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignmentcited by 150
  7. 2017On a Formal Model of Safe and Scalable Self-driving Carscited by 131
  8. 2023Hidden Biases of End-to-End Driving Modelscited by 96
  9. 2024Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimizationcited by 67
  10. 2019Neural Simplex Architecturecited by 29
  11. 2024On the Limited Generalization Capability of the Implicit Reward Model Induced by Direct Preference Optimizationcited by 27
  12. 2025GraphPilot: Grounded Scene Graph Conditioning for Language-Based Autonomous Drivingcited by 7
  13. 2025Enhancing LLM-based Autonomous Driving with Modular Traffic Light and Sign Recognitioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026CausalDriveBench: Evaluating Causal Reasoning in Vision-Language-Action Models for Autonomous Driving
  2. 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
  3. 2025A Survey on Vision-Language-Action Models for Autonomous Driving
  4. 2026RefineDrive: Reliable Failure-Guided Learning for Vision-Language-Action Driving
  5. 2025CARScenes: Semantic VLM Dataset for Safe Autonomous Driving
  6. 2026Less Language, More Latents: Annotation-Efficient VLAs for Driving
  7. 2026Vision and Language: Novel Representations and Artificial intelligence for Driving Scene Safety Assessment and Autonomous Vehicle Planning
  8. 2025DriveMind: A Dual Visual Language Model-based Reinforcement Learning Framework for Autonomous Driving