Vision-Based Traffic Accident Detection and Anticipation: A Survey
Not on the map. Why?
Abstract (arXiv)
Traffic accident detection and anticipation is an obstinate road safety problem and painstaking efforts have been devoted. With the rapid growth of video data, Vision-based Traffic Accident Detection and Anticipation (named Vision-TAD and Vision-TAA) become the last one-mile problem for safe driving and surveillance safety. However, the long-tailed, unbalanced, highly dynamic, complex, and uncertain properties of traffic accidents form the Out-of-Distribution (OOD) feature for Vision-TAD and Vision-TAA. Current AI development may focus on these OOD but important problems. What has been done for Vision-TAD and Vision-TAA? What direction we should focus on in the future for this problem? A comprehensive survey is important. We present the first survey on Vision-TAD in the deep learning era and the first-ever survey for Vision-TAA. The pros and cons of each research prototype are discussed in detail during the investigation. In addition, we also provide a critical review of 31 publicly available benchmarks and related evaluation metrics. Through this survey, we want to spawn new insights and open possible trends for Vision-TAD and Vision-TAA tasks.
Key facts. Cited by 31 papers in the map (data through 14 Oct 2026). Builds on 65 of its 153 references that are in the map. First posted on arXiv 30 Aug 2023.
Builds on
65 of 153 references.
References · 65
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2018YOLOv3: An Incremental Improvementcited by 2,659
- 2022Video Diffusion Modelscited by 2,305
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2016Simple Online and Realtime Trackingcited by 868
- 2021Domain Generalization: A Surveycited by 764
- 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
38 more
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2022Masked Siamese Networks for Label-Efficient Learningcited by 302
- 2016Structured Sequence Modeling with Graph Convolutional Recurrent Networkscited by 275
- 2017Gate-Variants of Gated Recurrent Unit (GRU) Neural Networkscited by 242
- 2020Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentationcited by 222
- 2014Recurrent Neural Network Regularizationcited by 189
- 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 157
- 2022DRAMA: Joint Risk Localization and Captioning in Drivingcited by 126
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 89
- 2020A Survey of Single-Scene Video Anomaly Detectioncited by 88
- 2021SUTD-TrafficQA: A Question Answering Benchmark and an Efficient Network for Video Reasoning over Traffic Eventscited by 84
- 2022Multi-modal Sensor Fusion for Auto Driving Perception: A Surveycited by 76
- 2023DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Drivingcited by 73
- 2019Unsupervised Traffic Accident Detection in First-Person Videoscited by 70
- 2019DADA: Driver Attention Prediction in Driving Accident Scenarioscited by 70
- 2022Invariant Grounding for Video Question Answeringcited by 68
- 2023Generalized Video Anomaly Event Detection: Systematic Taxonomy and Comparison of Deep Modelscited by 59
- 2019DADA-2000: Can Driving Accident be Predicted by Driver Attention? Analyzed by A Benchmarkcited by 57
- 2020Localizing Anomalies from Weakly-Labeled Videoscited by 52
- 2018Anticipating Traffic Accidents with Adaptive Loss and Large-scale Incident DBcited by 51
- 2021DRIVE: Deep Reinforced Accident Anticipation with Visual Explanationcited by 46
- 2015Recurrent Neural Networks for Driver Activity Anticipation via Sensory-Fusion Architecturecited by 42
- 2020VehicleNet: Learning Robust Visual Representation for Vehicle Re-identificationcited by 42
- 2021A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic Accidentscited by 42
- 2018CADP: A Novel Dataset for CCTV Traffic Camera based Accident Analysiscited by 39
- 2020Scene-Graph Augmented Data-Driven Risk Assessment of Autonomous Vehicle Decisionscited by 34
- 2017Agent-Centric Risk Assessment: Accident Anticipation and Risky Region Localizationcited by 33
- 2021Weakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Videocited by 32
- 2019Anomaly Detection in Road Traffic Using Visual Surveillance: A Surveycited by 30
- 2021Spatio-Temporal Scene-Graph Embedding for Autonomous Vehicle Collision Predictioncited by 29
- 2017End-to-End United Video Dehazing and Detectioncited by 24
- 2021Exploring Event-driven Dynamic Context for Accident Scene Segmentationcited by 23
- 2023Weakly Supervised Anomaly Detection: A Surveycited by 22
- 2022TAD: A Large-Scale Benchmark for Traffic Accidents Detection from Video Surveillancecited by 20
- 2022Visual Anomaly Detection Via Partition Memory Bank Module and Error Estimationcited by 20
- 2018VIENA2: A Driving Anticipation Datasetcited by 19
- 2020Global Feature Aggregation for Accident Anticipationcited by 17
- 2020Towards Anomaly Detection in Dashcam Videoscited by 16
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 17; 2026: 7.
31 papers.
Sort:
By area:
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modelingcited by 13
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptionscited by 13
- 2023Smart City Transportation: Deep Learning Ensemble Approach for Traffic Accident Detectioncited by 8
- 2025World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Drivingcited by 8
- 2026ACCIDENT: A Benchmark Dataset for Vehicle Accident Detection from Traffic Surveillance Videoscited by 7
- 2025SafePLUG: Empowering Multimodal LLMs with Pixel-Level Insight and Temporal Grounding for Traffic Accident Understandingcited by 6
- 2023Classifier-head Informed Feature Masking and Prototype-based Logit Smoothing for Out-of-Distribution Detectioncited by 5
- 2025Domain-Enhanced Dual-Branch Model for Efficient and Interpretable Accident Anticipationcited by 5
- 2025Accident Anticipation via Temporal Occurrence Predictioncited by 4
- 2024CycleCrash: A Dataset of Bicycle Collision Videos for Collision Prediction and Analysiscited by 3
- 2025Learning collision risk proactively from naturalistic driving data at scalecited by 3
19 more
- 2025When Every Millisecond Counts: Real-Time Anomaly Detection via the Multimodal Asynchronous Hybrid Networkcited by 3
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Datasetcited by 2
- 2025AccidentSim: Generating Vehicle Collision Videos with Physically Realistic Collision Trajectories from Real-World Accident Reportscited by 2
- 2025EQ-TAA: Equivariant Traffic Accident Anticipation via Diffusion-Based Accident Video Synthesiscited by 2
- 2024Hybrid Video Anomaly Detection for Anomalous Scenarios in Autonomous Drivingcited by 1
- 2025Enhancing Highway Safety: Accident Detection on the A9 Test Stretch Using Roadside Sensorscited by 1
- 2025Deep Learning Advances in Vision-Based Traffic Accident Anticipation: A Comprehensive Review of Methods, Datasets, and Future Directionscited by 1
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studiescited by 1
- 2025STAGNet: A Spatio-Temporal Graph and LSTM Framework for Accident Anticipationcited by 1
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Modelscited by 1
- 2026VAGNet: Vision-based Accident Anticipation with Global Featurescited by 1
- 2026TrafficRAG: A Multimodal RAG Framework for Traffic Accident Liability Determinationcited by 1
- 2025MsFIN: Multi-scale Feature Interaction Network for Traffic Accident Anticipationcited by 0
- 2025ROAR: Robust Accident Recognition and Anticipation for Autonomous Drivingcited by 0
- 2025Predictive Sample Assignment for Semantically Coherent Out-of-Distribution Detectioncited by 0
- 2026Learning from the Unseen: Generative Data Augmentation for Geometric-Semantic Accident Anticipationcited by 0
- 2026Two-Pass Zero-Shot Temporal-Spatial Grounding of Rare Traffic Events in Surveillance Videocited by 0
- 2026Metadata-Aware Multi-Prompt Reasoning for Zero-Shot Accident Understandingcited by 0
- 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understandingcited by 0
- 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding9 Jul 2026
- 2026Metadata-Aware Multi-Prompt Reasoning for Zero-Shot Accident Understanding10 Jun 2026
- 2026TrafficRAG: A Multimodal RAG Framework for Traffic Accident Liability Determination1 Jun 2026
- 2026Two-Pass Zero-Shot Temporal-Spatial Grounding of Rare Traffic Events in Surveillance Video2 May 2026
- 2026Learning from the Unseen: Generative Data Augmentation for Geometric-Semantic Accident Anticipation29 Apr 2026
- 2026ACCIDENT: A Benchmark Dataset for Vehicle Accident Detection from Traffic Surveillance Videos10 Apr 2026
- 2026VAGNet: Vision-based Accident Anticipation with Global Features10 Apr 2026
- 2025Predictive Sample Assignment for Semantically Coherent Out-of-Distribution Detection15 Dec 2025
- 2025ROAR: Robust Accident Recognition and Anticipation for Autonomous Driving9 Nov 2025
- 2025Accident Anticipation via Temporal Occurrence Prediction25 Oct 2025
- 2025MsFIN: Multi-scale Feature Interaction Network for Traffic Accident Anticipation23 Sep 2025
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Models23 Sep 2025
19 more
- 2025STAGNet: A Spatio-Temporal Graph and LSTM Framework for Accident Anticipation21 Aug 2025
- 2025SafePLUG: Empowering Multimodal LLMs with Pixel-Level Insight and Temporal Grounding for Traffic Accident Understanding9 Aug 2025
- 2025World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving17 Jul 2025
- 2025Domain-Enhanced Dual-Branch Model for Efficient and Interpretable Accident Anticipation17 Jul 2025
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studies9 Jul 2025
- 2025When Every Millisecond Counts: Real-Time Anomaly Detection via the Multimodal Asynchronous Hybrid Network20 Jun 2025
- 2025Learning collision risk proactively from naturalistic driving data at scale19 May 2025
- 2025Deep Learning Advances in Vision-Based Traffic Accident Anticipation: A Comprehensive Review of Methods, Datasets, and Future Directions12 May 2025
- 2025AccidentSim: Generating Vehicle Collision Videos with Physically Realistic Collision Trajectories from Real-World Accident Reports26 Mar 2025
- 2025EQ-TAA: Equivariant Traffic Accident Anticipation via Diffusion-Based Accident Video Synthesis16 Mar 2025
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Dataset15 Mar 2025
- 2025Enhancing Highway Safety: Accident Detection on the A9 Test Stretch Using Roadside Sensors1 Feb 2025
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptions14 Dec 2024
- 2024CycleCrash: A Dataset of Bicycle Collision Videos for Collision Prediction and Analysis30 Sep 2024
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modeling2 Sep 2024
- 2024Hybrid Video Anomaly Detection for Anomalous Scenarios in Autonomous Driving10 Jun 2024
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Dataset7 Feb 2024
- 2023Classifier-head Informed Feature Masking and Prototype-based Logit Smoothing for Out-of-Distribution Detection27 Oct 2023
- 2023Smart City Transportation: Deep Learning Ensemble Approach for Traffic Accident Detection16 Oct 2023
- 2025SafePLUG: Empowering Multimodal LLMs with Pixel-Level Insight and Temporal Grounding for Traffic Accident Understandingcited by 6
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Modelscited by 1
- 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understandingcited by 0
- 2026AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding9 Jul 2026
- 2025Investigating Traffic Accident Detection Using Multimodal Large Language Models23 Sep 2025
- 2025SafePLUG: Empowering Multimodal LLMs with Pixel-Level Insight and Temporal Grounding for Traffic Accident Understanding9 Aug 2025
- 2024Advancing Video Anomaly Detection: A Concise Review and a New Datasetcited by 49
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modelingcited by 13
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptionscited by 13
- 2023Smart City Transportation: Deep Learning Ensemble Approach for Traffic Accident Detectioncited by 8
- 2026ACCIDENT: A Benchmark Dataset for Vehicle Accident Detection from Traffic Surveillance Videoscited by 7
- 2023Classifier-head Informed Feature Masking and Prototype-based Logit Smoothing for Out-of-Distribution Detectioncited by 5
- 2025Domain-Enhanced Dual-Branch Model for Efficient and Interpretable Accident Anticipationcited by 5
- 2025Accident Anticipation via Temporal Occurrence Predictioncited by 4
- 2024CycleCrash: A Dataset of Bicycle Collision Videos for Collision Prediction and Analysiscited by 3
- 2025Learning collision risk proactively from naturalistic driving data at scalecited by 3
- 2025When Every Millisecond Counts: Real-Time Anomaly Detection via the Multimodal Asynchronous Hybrid Networkcited by 3
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Datasetcited by 2
12 most cited of 24 All 24 (JSON)
- 2026Two-Pass Zero-Shot Temporal-Spatial Grounding of Rare Traffic Events in Surveillance Video2 May 2026
- 2026Learning from the Unseen: Generative Data Augmentation for Geometric-Semantic Accident Anticipation29 Apr 2026
- 2026ACCIDENT: A Benchmark Dataset for Vehicle Accident Detection from Traffic Surveillance Videos10 Apr 2026
- 2026VAGNet: Vision-based Accident Anticipation with Global Features10 Apr 2026
- 2025Predictive Sample Assignment for Semantically Coherent Out-of-Distribution Detection15 Dec 2025
- 2025ROAR: Robust Accident Recognition and Anticipation for Autonomous Driving9 Nov 2025
- 2025Accident Anticipation via Temporal Occurrence Prediction25 Oct 2025
- 2025MsFIN: Multi-scale Feature Interaction Network for Traffic Accident Anticipation23 Sep 2025
- 2025STAGNet: A Spatio-Temporal Graph and LSTM Framework for Accident Anticipation21 Aug 2025
- 2025Domain-Enhanced Dual-Branch Model for Efficient and Interpretable Accident Anticipation17 Jul 2025
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studies9 Jul 2025
- 2025When Every Millisecond Counts: Real-Time Anomaly Detection via the Multimodal Asynchronous Hybrid Network20 Jun 2025
12 newest of 24 All 24 (JSON)