DRAMA-X: A Fine-grained Intent Prediction and Risk Reasoning Benchmark For Driving
On the map: LLM reasoning → Chain-of-thought reasoning for driving
also in 1 more
Abstract (arXiv)
Understanding the short-term motion of vulnerable road users (VRUs) like pedestrians and cyclists is critical for safe autonomous driving, especially in urban scenarios with ambiguous or high-risk behaviors. While vision-language models (VLMs) have enabled open-vocabulary perception, their utility for fine-grained intent reasoning remains underexplored. Notably, no existing benchmark evaluates multi-class intent prediction in safety-critical situations, To address this gap, we introduce DRAMA-X, a fine-grained benchmark constructed from the DRAMA dataset via an automated annotation pipeline. DRAMA-X contains 5,686 accident-prone frames labeled with object bounding boxes, a nine-class directional intent taxonomy, binary risk scores, expert-generated action suggestions for the ego vehicle, and descriptive motion summaries. These annotations enable a structured evaluation of four interrelated tasks central to autonomous decision-making: object detection, intent prediction, risk assessment, and action suggestion. As a reference baseline, we propose SGG-Intent, a lightweight, training-free framework that mirrors the ego vehicle's reasoning pipeline. It sequentially generates a scene graph from visual input using VLM-backed detectors, infers intent, assesses risk, and recommends an action using a compositional reasoning stage powered by a large language model. We evaluate a range of recent VLMs, comparing performance across all four DRAMA-X tasks. Our experiments demonstrate that scene-graph-based reasoning enhances intent prediction and risk assessment, especially when contextual cues are explicitly modeled.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 21 of its 66 references that are in the map. First posted on arXiv 21 Jun 2025.
Builds on
21 of 66 references.
Closest ancestors · 3
Same direction, newest first
- 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving3 Jun
- 2024AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous Driving19 Dec
- 2024WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving5 Jul
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
- 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
- 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
- 2024NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samplescited by 97
- 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Modelscited by 47
- 2024SimpleLLM4AD: An End-to-End Vision-Language Model with Graph Visual Question Answering for Autonomous Drivingcited by 16
6 more
- 2024Using Multimodal Large Language Models for Automated Detection of Traffic Safety Critical Eventscited by 7
- 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
- 2025PRISM-0: A Predicate-Rich Scene Graph Generation Framework for Zero-Shot Open-Vocabulary Taskscited by 5
- 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happencited by 5
- 2024End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Promptingcited by 3
- 2021IRS-Assisted Active Device Detectioncited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Modelscited by 10
- 2025Automated Vehicles Should be Connected with Natural Languagecited by 5
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous drivingcited by 3
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Drivingcited by 2
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAscited by 1
- 2026A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving8 Jul 2026
- 2026Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAs22 Jun 2026
- 2026Bench2Drive-VL: Benchmarks for Closed-Loop Autonomous Driving with Vision-Language Models1 Apr 2026
- 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Driving20 Oct 2025
- 2025Automated Vehicles Should be Connected with Natural Language29 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
- 2026Vision and Language: Novel Representations and Artificial intelligence for Driving Scene Safety Assessment and Autonomous Vehicle Planning
- 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models
- 2025Evaluation of Safety Cognition Capability in Vision-Language Models for Autonomous Driving
- 2025Seeing before Observable: Potential Risk Reasoning in Autonomous Driving via Vision Language Models
- 2026ScenePilot-4K: A Large-Scale First-Person Dataset and Benchmark for Vision-Language Models in Autonomous Driving
- 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving
- 2026Large Language Model based Interactive Decision-Making for Autonomous Driving