Towards Vision Zero: The TUM Traffic Accid3nD Dataset
Not on the map. Why?
Abstract (arXiv)
Even though a significant amount of work has been done to increase the safety of transportation networks, accidents still occur regularly. They must be understood as unavoidable and sporadic outcomes of traffic networks. No public dataset contains 3D annotations of real-world accidents recorded from roadside camera and LiDAR sensors. We present the TUM Traffic Accid3nD (TUMTraf-Accid3nD) dataset, a collection of real-world highway accidents in different weather and lighting conditions. It contains vehicle crashes at high-speed driving with 2,634,233 labeled 2D bounding boxes, instance masks, and 3D bounding boxes with track IDs. In total, the dataset contains 111,945 labeled image and point cloud frames recorded from four roadside cameras and LiDARs at 25 Hz. The dataset contains six object classes and is provided in the OpenLABEL format. We propose an accident detection model that combines a rule-based approach with a learning-based one. Experiments and ablation studies on our dataset show the robustness of our proposed method. The dataset, model, and code are available on our website: https://accident-dataset.github.io.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 41 of its 66 references that are in the map. First posted on arXiv 15 Mar 2025.
Builds on
41 of 66 references.
References · 41
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
- 2023Vision Language Models in Autonomous Driving: A Survey and Outlookcited by 126
- 2020Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learningcited by 91
- 2023DeepAccident: A Motion and Accident Prediction Benchmark for V2X Autonomous Drivingcited by 73
- 2019Unsupervised Traffic Accident Detection in First-Person Videoscited by 70
- 2024TUMTraf V2X Cooperative Perception Datasetcited by 67
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 66
- 2021DRIVE: Deep Reinforced Accident Anticipation with Visual Explanationcited by 46
- 2024Abductive Ego-View Accident Video Understanding for Safe Driving Perceptioncited by 43
29 more
- 2021LaneAF: Robust Multi-Lane Detection with Affinity Fieldscited by 41
- 2018CADP: A Novel Dataset for CCTV Traffic Camera based Accident Analysiscited by 39
- 20193D BAT: A Semi-Automatic, Web-based 3D Annotation Toolbox for Full-Surround, Multi-Modal Data Streamscited by 36
- 2023Poly-MOT: A Polyhedral Framework For 3D Multi-Object Trackingcited by 32
- 2023Vision-Based Traffic Accident Detection and Anticipation: A Surveycited by 31
- 2021IPS300+: a Challenging Multimodal Dataset for Intersection Perception Systemcited by 26
- 2023InfraDet3D: Multi-Modal 3D Object Detection based on Roadside Infrastructure Camera and LiDAR Sensorscited by 25
- 2024Towards Explainable, Safe Autonomous Driving with Language Embeddings for Novelty Identification and Active Learning: Framework and Experimental Analysis with Real-World Data Setscited by 25
- 2022TAD: A Large-Scale Benchmark for Traffic Accidents Detection from Video Surveillancecited by 20
- 2025AVD2: Accident Video Diffusion for Accident Video Descriptioncited by 20
- 2018VIENA2: A Driving Anticipation Datasetcited by 19
- 2019Providentia -- A Large-Scale Sensor System for the Assistance of Autonomous Vehicles and Its Evaluationcited by 17
- 2024The Why, When, and How to Use Active Learning in Large-Data-Driven 3D Object Detection for Safe Autonomous Driving: An Empirical Explorationcited by 17
- 2024ActiveAnno3D -- An Active Learning Framework for Multi-Modal 3D Object Detectioncited by 17
- 2024GPT-4V as Traffic Assistant: An In-depth Look at Vision Language Model on Complex Traffic Eventscited by 16
- 2021Intelligent Transportation Systems Using External Infrastructure: A Literature Surveycited by 15
- 2023Safe Control Transitions: Machine Vision Based Observable Readiness Index and Data-Driven Takeover Time Predictioncited by 12
- 2023RiskBench: A Scenario-based Benchmark for Risk Identificationcited by 12
- 2022A Survey of Robust 3D Object Detection Methods in Point Cloudscited by 10
- 2022Real-Time and Robust 3D Object Detection Within Road-Side LiDARs Using Domain Adaptationcited by 10
- 2018Drive Video Analysis for the Detection of Traffic Near-Miss Incidentscited by 9
- 2022Real-Time And Robust 3D Object Detection with Roadside LiDARscited by 9
- 2023Pedestrian Behavior Maps for Safety Advisories: CHAMP Framework and Real-World Data Analysiscited by 9
- 2024WARM-3D: A Weakly-Supervised Sim2Real Domain Adaptation Framework for Roadside Monocular 3D Object Detectioncited by 9
- 2022Planning with Occluded Traffic Agents using Bi-Level Variational Occlusion Modelscited by 5
- 2024GraphRelate3D: Context-Dependent 3D Object Detection with Inter-Object Relationship Graphscited by 3
- 2024Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detectioncited by 2
- 2021Deep Representation of Imbalanced Spatio-temporal Traffic Flow Data for Traffic Accident Detectioncited by 1
- 2024Hybrid Video Anomaly Detection for Anomalous Scenarios in Autonomous Drivingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.