mlsanityData to 14 Oct 2026

Hierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos

arXiv 2510.12190 ↗First posted 14 Oct 2025cs.CVcited by 0

On the map: LLM reasoning → Chain-of-thought reasoning for driving

also in 1 more
Abstract (arXiv)

Recent advances in end-to-end (E2E) autonomous driving have been enabled by training on diverse large-scale driving datasets, yet autonomous driving models still struggle in out-of-distribution (OOD) scenarios. The COOOL benchmark targets this gap by encouraging hazard understanding beyond closed taxonomies, and the 2COOOL challenge extends it to generating human-interpretable incident reports. We present a hierarchical reasoning framework for incident report generation from dashcam videos that integrates frame-level captioning, incident frame detection, and fine-grained reasoning within vision-language models (VLMs). We further improve factual accuracy and readability through model ensembling and a Blind A/B Scoring selection protocol. On the official 2COOOL open leaderboard, our method ranks 2nd among 29 teams and achieves the best CIDEr-D score, producing accurate and coherent incident narratives. These results indicate that hierarchical reasoning with VLMs is a promising direction for accident analysis and for broader understanding of safety-critical traffic events. The implementation and code are available at https://github.com/riron1206/kaggle-2COOOL-2nd-Place-Solution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chain-of-thought reasoning for driving, one of 17 directions in LLM reasoning. Builds on 3 of its 21 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

3 of 21 references.

References · 3

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  3. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding
  2. 2026VLM-AutoDrive: Post-Training Vision-Language Models for Safety-Critical Autonomous Driving Events
  3. 2025VRU-Accident: A Vision-Language Benchmark for Video Question Answering and Dense Captioning for Accident Scene Understanding
  4. 2026CAViAR: A Causal Video Dataset for Fine-Grained Accident Reasoning in Real-World Scenarios
  5. 2026CrashSight: A Phase-Aware, Infrastructure-Centric Video Benchmark for Traffic Crash Scene Understanding and Reasoning
  6. 2025Addressing Out-of-Label Hazard Detection in Dashcam Videos: Insights from the COOOL Challenge
  7. 2025AVD2: Accident Video Diffusion for Accident Video Description
  8. 2026Observe Before You Alert: Adaptive Driver Alerting with Vision-Language Models