World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence of crucial object-level cues due to environmental disruptions or sensor deficiencies. To tackle these issues, we propose a comprehensive framework combining generative scene augmentation with adaptive temporal reasoning. Specifically, we develop a video generation pipeline that utilizes a world model guided by domain-informed prompts to create high-resolution, statistically consistent driving scenarios, particularly enriching the coverage of edge cases and complex interactions. In parallel, we construct a dynamic prediction model that encodes spatio-temporal relationships through strengthened graph convolutions and dilated temporal operators, effectively addressing data incompleteness and transient visual noise. Furthermore, we release a new benchmark dataset designed to better capture diverse real-world driving risks. Extensive experiments on public and newly released datasets confirm that our framework enhances both the accuracy and lead time of accident anticipation, offering a robust solution to current data and modeling limitations in safety-critical autonomous driving applications.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 41 of its 76 references that are in the map. First posted on arXiv 17 Jul 2025.
Builds on
41 of 76 references.
Closest ancestors · 4
Same direction, newest first
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024World Models for Autonomous Driving: An Initial Survey5 Mar
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
Other references · 37
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
- 2022Planning-oriented Autonomous Drivingcited by 1,087
25 more
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
- 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
- 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
- 2020Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learningcited by 91
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
- 2019Unsupervised Traffic Accident Detection in First-Person Videoscited by 70
- 2018Anticipating Traffic Accidents with Adaptive Loss and Large-scale Incident DBcited by 51
- 2021A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic Accidentscited by 42
- 2020Scene-Graph Augmented Data-Driven Risk Assessment of Autonomous Vehicle Decisionscited by 34
- 2017Agent-Centric Risk Assessment: Accident Anticipation and Risky Region Localizationcited by 33
- 2022NMS Strikes Backcited by 33
- 2023Vision-Based Traffic Accident Detection and Anticipation: A Surveycited by 31
- 2021Spatio-Temporal Scene-Graph Embedding for Autonomous Vehicle Collision Predictioncited by 29
- 2020Global Feature Aggregation for Accident Anticipationcited by 17
- 2024DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videoscited by 16
- 2024CRASH: Crash Recognition and Anticipation System Harnessing with Context-Aware and Temporal Focus Attentionscited by 14
- 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modelingcited by 13
- 2024Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understandingcited by 10
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 2025Think Before You Drive: World Model-Inspired Multimodal Grounding for Autonomous Vehiclescited by 2
- 2025Deep Learning Perspective of Scene Understanding in Autonomous Robotscited by 0
- 2026ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generationcited by 0
- 2026KG-ASG: Collision-Knowledge-Guided Closed-Loop Adversarial Scenario Generation With Primary-Support Attributioncited by 0
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessmentcited by 0
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platformcited by 0
- 2026AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understandingcited by 0
- 2026AUGUstus: Autonomous Driving VLA Model with Unified Generation and Understanding12 Oct 2026
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform1 Oct 2026
- 2026NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment5 Aug 2026
- 2026KG-ASG: Collision-Knowledge-Guided Closed-Loop Adversarial Scenario Generation With Primary-Support Attribution17 May 2026
- 2026ScenarioControl: Vision-Language Controllable Vectorized Latent Scenario Generation18 Apr 2026
- 2025Deep Learning Perspective of Scene Understanding in Autonomous Robots16 Dec 2025
- 2025Think Before You Drive: World Model-Inspired Multimodal Grounding for Autonomous Vehicles3 Dec 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Risk-Controllable Multi-View Diffusion for Driving Scenario Generation
- 2025INSIGHT: Enhancing Autonomous Driving Safety through Vision-Language Models on Context-Aware Hazard Detection and Edge Case Evaluation
- 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
- 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT
- 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
- 2025A Survey of World Models for Autonomous Driving
- 2026LMGenDrive: Bridging Multimodal Understanding and Generative World Modeling for End-to-End Driving