Hierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos
On the map: LLM reasoning → Chain-of-thought reasoning for driving
Abstract (arXiv)
Recent advances in end-to-end (E2E) autonomous driving have been enabled by training on diverse large-scale driving datasets, yet autonomous driving models still struggle in out-of-distribution (OOD) scenarios. The COOOL benchmark targets this gap by encouraging hazard understanding beyond closed taxonomies, and the 2COOOL challenge extends it to generating human-interpretable incident reports. We present a hierarchical reasoning framework for incident report generation from dashcam videos that integrates frame-level captioning, incident frame detection, and fine-grained reasoning within vision-language models (VLMs). We further improve factual accuracy and readability through model ensembling and a Blind A/B Scoring selection protocol. On the official 2COOOL open leaderboard, our method ranks 2nd among 29 teams and achieves the best CIDEr-D score, producing accurate and coherent incident narratives. These results indicate that hierarchical reasoning with VLMs is a promising direction for accident analysis and for broader understanding of safety-critical traffic events. The implementation and code are available at https://github.com/riron1206/kaggle-2COOOL-2nd-Place-Solution.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 3 of its 21 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
3 of 21 references.
References · 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding
- 2026VLM-AutoDrive: Post-Training Vision-Language Models for Safety-Critical Autonomous Driving Events
- 2025VRU-Accident: A Vision-Language Benchmark for Video Question Answering and Dense Captioning for Accident Scene Understanding
- 2026CAViAR: A Causal Video Dataset for Fine-Grained Accident Reasoning in Real-World Scenarios
- 2026CrashSight: A Phase-Aware, Infrastructure-Centric Video Benchmark for Traffic Crash Scene Understanding and Reasoning
- 2025Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challenge
- 2025AVD2: Accident Video Diffusion for Accident Video Description
- 2026Observe Before You Alert: Adaptive Driver Alerting with Vision-Language Models