Responsibility Distribution Estimation in Ego-View Accident Videos with Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection
Abstract (arXiv)
Recent studies on multimodal traffic accident understanding have mainly relied on infrastructure-camera footage, satellite imagery, or structured crash records. However, such data sources are costly to deploy and maintain at large scale, and they cannot objectively capture what the driver was actually able to observe before the accident. In contrast, ego-view accident videos directly represent the driver's visual perspective, making them suitable for reasoning about avoidability and driver responsibility. In this paper, we introduce responsibility distribution estimation for ego-view traffic accident videos, a new task in which a model predicts the percentage of responsibility assigned to each involved agent. We construct an LLM-assisted responsibility annotation pipeline and fine-tune multimodal large language models under multiple input settings, including raw frames, segmentation-enhanced input, and textual descriptions. Experimental results establish a strong initial benchmark, demonstrating that multimodal LLMs can effectively perform this nuanced, constraint-based reasoning task. Our findings suggest that ego-centric accident videos provide a promising foundation for socially and legally meaningful multimodal reasoning beyond conventional accident classification and explanation tasks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 5 of its 8 references that are in the map. First posted on arXiv 3 Jul 2026.
Builds on
5 of 8 references.
References · 5
- 2024Abductive Ego-View Accident Video Understanding for Safe Driving Perceptioncited by 43
- 2024Leveraging Large Language Models with Chain-of-Thought and Prompt Engineering for Traffic Crash Severity Analysis and Inferencecited by 14
- 2024Learning Traffic Crashes as Language: Datasets, Benchmarks, and What-if Causal Analysescited by 10
- 2025CrashSage: A Large Language Model-Centered Framework for Contextual and Interpretable Traffic Crash Analysiscited by 6
- 2025CADD: A Chinese Traffic Accident Dataset for Statute-Based Liability Attributioncited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Interpretable Traffic Responsibility from Dashcam Video via Legal Multi Agent Reasoning
- 2026AITP: Traffic Accident Responsibility Allocation via Multimodal Large Language Models
- 2025CrashChat: A Multimodal Large Language Model for Multitask Traffic Crash Video Analysis
- 2025When language and vision meet road safety: leveraging multimodal large language models for video-based traffic accident analysis
- 2025AccidentBench: Benchmarking Multimodal Understanding and Reasoning in Vehicle Accidents and Beyond
- 2025Hierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos
- 2025AVD2: Accident Video Diffusion for Accident Video Description
- 2026TrafficRAG: A Multimodal RAG Framework for Traffic Accident Liability Determination