Dual-Stage LLM Framework for Scenario-Centric Semantic Interpretation in Driving Assistance
Not on the map. Why?
Abstract (arXiv)
Advanced Driver Assistance Systems (ADAS) increasingly rely on learning-based perception, yet safety-relevant failures often arise without component malfunction, driven instead by partial observability and semantic ambiguity in how risk is interpreted and communicated. This paper presents a scenario-centric framework for reproducible auditing of LLM-based risk reasoning in urban driving contexts. Deterministic, temporally bounded scenario windows are constructed from multimodal driving data and evaluated under fixed prompt constraints and a closed numeric risk schema, ensuring structured and comparable outputs across models. Experiments on a curated near-people scenario set compare two text-only models and one multimodal model under identical inputs and prompts. Results reveal systematic inter-model divergence in severity assignment, high-risk escalation, evidence use, and causal attribution. Disagreement extends to the interpretation of vulnerable road user presence, indicating that variability often reflects intrinsic semantic indeterminacy rather than isolated model failure. These findings highlight the importance of scenario-centric auditing and explicit ambiguity management when integrating LLM-based reasoning into safety-aligned driver assistance systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 22 references that are in the map. First posted on arXiv 29 Mar 2026.
Builds on
6 of 22 references.
References · 6
- 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
- 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 314
- 2023Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Drivingcited by 232
- 2021Explanations in Autonomous Driving: A Surveycited by 81
- 2024Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Reviewcited by 53
- 2025Multimodal Large Language Model Framework for Safe and Interpretable Grid-Integrated EVscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Case-based Reasoning Augmented Large Language Model Framework for Decision Making in Realistic Safety-Critical Driving Scenarios
- 2025Mind the Gap: Evaluating LLM Understanding of Human-Taught Road Safety Principles
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving
- 2025SAFE: Harnessing LLM for Scenario-Driven ADS Testing from Multimodal Crash Data ↗
- 2026DriveSafe: A Hierarchical Risk Taxonomy for Safety-Critical LLM-Based Driving Assistants
- 2025Why Braking? Scenario Extraction and Reasoning Utilizing LLM
- 2025Driving Through Uncertainty: Risk-Averse Control with LLM Commonsense for Autonomous Driving under Perception Deficits
- 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving