mlsanityData to 14 Oct 2026

World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving

arXiv 2507.12762 ↗First posted 17 Jul 2025cs.CV cs.LGcited by 8

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence of crucial object-level cues due to environmental disruptions or sensor deficiencies. To tackle these issues, we propose a comprehensive framework combining generative scene augmentation with adaptive temporal reasoning. Specifically, we develop a video generation pipeline that utilizes a world model guided by domain-informed prompts to create high-resolution, statistically consistent driving scenarios, particularly enriching the coverage of edge cases and complex interactions. In parallel, we construct a dynamic prediction model that encodes spatio-temporal relationships through strengthened graph convolutions and dilated temporal operators, effectively addressing data incompleteness and transient visual noise. Furthermore, we release a new benchmark dataset designed to better capture diverse real-world driving risks. Extensive experiments on public and newly released datasets confirm that our framework enhances both the accuracy and lead time of accident anticipation, offering a robust solution to current data and modeling limitations in safety-critical autonomous driving applications.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 41 of its 76 references that are in the map. First posted on arXiv 17 Jul 2025.

Builds on

41 of 76 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  2. 2024World Models for Autonomous Driving: An Initial Survey5 Mar
  3. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
  4. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  6. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  7. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  8. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  9. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  10. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  11. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
  12. 2022Planning-oriented Autonomous Drivingcited by 1,087
25 more
  1. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
  2. 2020Mastering Atari with Discrete World Modelscited by 1,007
  3. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  4. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  5. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  6. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 519
  7. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  8. 2020The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memescited by 490
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  10. 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
  11. 2020Uncertainty-based Traffic Accident Anticipation with Spatio-Temporal Relational Learningcited by 91
  12. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
  13. 2019Unsupervised Traffic Accident Detection in First-Person Videoscited by 70
  14. 2018Anticipating Traffic Accidents with Adaptive Loss and Large-scale Incident DBcited by 51
  15. 2021A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic Accidentscited by 42
  16. 2020Scene-Graph Augmented Data-Driven Risk Assessment of Autonomous Vehicle Decisionscited by 34
  17. 2017Agent-Centric Risk Assessment: Accident Anticipation and Risky Region Localizationcited by 33
  18. 2022NMS Strikes Backcited by 33
  19. 2023Vision-Based Traffic Accident Detection and Anticipation: A Surveycited by 31
  20. 2021Spatio-Temporal Scene-Graph Embedding for Autonomous Vehicle Collision Predictioncited by 29
  21. 2020Global Feature Aggregation for Accident Anticipationcited by 17
  22. 2024DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videoscited by 16
  23. 2024CRASH: Crash Recognition and Anticipation System Harnessing with Context-Aware and Temporal Focus Attentionscited by 14
  24. 2024Real-time Accident Anticipation for Autonomous Driving Through Monocular Depth-Enhanced 3D Modelingcited by 13
  25. 2024Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understandingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Risk-Controllable Multi-View Diffusion for Driving Scenario Generation
  2. 2025INSIGHT: Enhancing Autonomous Driving Safety through Vision-Language Models on Context-Aware Hazard Detection and Edge Case Evaluation
  3. 2026Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
  4. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
  5. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT
  6. 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
  7. 2025A Survey of World Models for Autonomous Driving
  8. 2026LMGenDrive: Bridging Multimodal Understanding and Generative World Modeling for End-to-End Driving