Zero-Shot Traffic Accident Detection via a Coarse-to-Fine VLM-Tracking Pipeline
Not on the map. Why?
Abstract (arXiv)
Traffic surveillance cameras capture accidents continuously, yet converting raw CCTV footage into structured event records that pinpoint when, where, and what type of collision occurred remains unsolved at scale. The ACCIDENT @ CVPR benchmark evaluates exactly this joint prediction under a strict constraint: no labeled real-world training data is available. We introduce a training-free, two-pass coarse-to-fine pipeline that pairs a frozen Qwen3-VL-32B-Instruct vision-language model with YOLO11x object detection and BoT-SORT tracking. A first pass sparsely samples the full clip to anchor the collision moment in time; a second pass re-examines a tight window around that estimate using frames annotated with stable vehicle identities and normalized bounding-box coordinates, which gives the model both a visual overlay and an explicit numeric description of the same scene. On the official 2,027-clip real-CCTV test set, our system achieves a three-way harmonic mean score of 0.504, surpassing all organizer-published baselines including the best multi-model ensemble (0.412) by a 22% relative margin.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 17 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
13 of 17 references.
References · 13
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2022BoT-SORT: Robust Associations Multi-Pedestrian Trackingcited by 313
- 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 215
- 2024Harnessing Large Language Models for Training-free Video Anomaly Detectioncited by 85
- 2025STER-VLM: Spatio-Temporal With Enhanced Reference Vision-Language Modelscited by 9
- 2026ACCIDENT: A Benchmark Dataset for Vehicle Accident Detection from Traffic Surveillance Videoscited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Two-Pass Zero-Shot Temporal-Spatial Grounding of Rare Traffic Events in Surveillance Video
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Models
- 2026Multi-Stage VLM Pipeline for Zero-Shot Traffic Accident Understanding
- 2025Hierarchical Reasoning with Vision-Language Models for Incident Reports from Dashcam Videos
- 2025Surveillance Video-Based Traffic Accident Detection Using Transformer Architecture
- 2024Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understanding
- 2026Metadata-Aware Multi-Prompt Reasoning for Zero-Shot Accident Understanding
- 2025When language and vision meet road safety: leveraging multimodal large language models for video-based traffic accident analysis