mlsanityData to 14 Oct 2026

DRAMA-X: A Fine-grained Intent Prediction and Risk Reasoning Benchmark For Driving

arXiv 2506.17590 ↗First posted 21 Jun 2025cs.CV cs.AI cs.ROcited by 5

On the map: LLM reasoning → Chain-of-thought reasoning for driving

also in 1 more
Abstract (arXiv)

Understanding the short-term motion of vulnerable road users (VRUs) like pedestrians and cyclists is critical for safe autonomous driving, especially in urban scenarios with ambiguous or high-risk behaviors. While vision-language models (VLMs) have enabled open-vocabulary perception, their utility for fine-grained intent reasoning remains underexplored. Notably, no existing benchmark evaluates multi-class intent prediction in safety-critical situations, To address this gap, we introduce DRAMA-X, a fine-grained benchmark constructed from the DRAMA dataset via an automated annotation pipeline. DRAMA-X contains 5,686 accident-prone frames labeled with object bounding boxes, a nine-class directional intent taxonomy, binary risk scores, expert-generated action suggestions for the ego vehicle, and descriptive motion summaries. These annotations enable a structured evaluation of four interrelated tasks central to autonomous decision-making: object detection, intent prediction, risk assessment, and action suggestion. As a reference baseline, we propose SGG-Intent, a lightweight, training-free framework that mirrors the ego vehicle's reasoning pipeline. It sequentially generates a scene graph from visual input using VLM-backed detectors, infers intent, assesses risk, and recommends an action using a compositional reasoning stage powered by a large language model. We evaluate a range of recent VLMs, comparing performance across all four DRAMA-X tasks. Our experiments demonstrate that scene-graph-based reasoning enhances intent prediction and risk assessment, especially when contextual cues are explicitly modeled.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 21 of its 66 references that are in the map. First posted on arXiv 21 Jun 2025.

Builds on

21 of 66 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025V2X-UniPool: Unifying Multimodal Perception and Knowledge Reasoning for Autonomous Driving3 Jun
  2. 2024AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous Driving19 Dec
  3. 2024WOMD-Reasoning: A Large-Scale Dataset for Interaction Reasoning in Driving5 Jul

Other references · 18

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  4. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  5. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  6. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  7. 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 320
  8. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Modelscited by 164
  9. 2024Senna: Bridging Large Vision-Language Models and End-to-End Autonomous Drivingcited by 156
  10. 2024NaturalBench: Evaluating Vision-Language Models on Natural Adversarial Samplescited by 97
  11. 2024V2X-VLM: End-to-End V2X Cooperative Autonomous Driving Through Large Vision-Language Modelscited by 47
  12. 2024SimpleLLM4AD: An End-to-End Vision-Language Model with Graph Visual Question Answering for Autonomous Drivingcited by 16
6 more
  1. 2024Using Multimodal Large Language Models for Automated Detection of Traffic Safety Critical Eventscited by 7
  2. 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
  3. 2025PRISM-0: A Predicate-Rich Scene Graph Generation Framework for Zero-Shot Open-Vocabulary Taskscited by 5
  4. 2025Simulating the Unseen: Crash Prediction Must Learn from What Did Not Happencited by 5
  5. 2024End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Promptingcited by 3
  6. 2021IRS-Assisted Active Device Detectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 3.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
  2. 2026Vision and Language: Novel Representations and Artificial intelligence for Driving Scene Safety Assessment and Autonomous Vehicle Planning
  3. 2025DriveAction: A Benchmark for Exploring Human-like Driving Decisions in VLA Models
  4. 2025Evaluation of Safety Cognition Capability in Vision-Language Models for Autonomous Driving
  5. 2025Seeing before Observable: Potential Risk Reasoning in Autonomous Driving via Vision Language Models
  6. 2026ScenePilot-4K: A Large-Scale First-Person Dataset and Benchmark for Vision-Language Models in Autonomous Driving
  7. 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving
  8. 2026Large Language Model based Interactive Decision-Making for Autonomous Driving