mlsanityData to 7 Oct 2026

Risk-Controllable Multi-View Diffusion for Driving Scenario Generation

arXiv 2603.11534 ↗First posted 12 Mar 2026cs.CVcited by 1

On the map: End-to-end autonomous driving → Generative simulation for driving

Abstract (arXiv)

Generating safety-critical driving scenarios is crucial for evaluating and improving autonomous driving systems, but long-tail risky situations are rarely observed in real-world data and difficult to specify through manual scenario design. Existing generative approaches typically treat risk as an after-the-fact label and struggle to maintain geometric consistency in multi-view driving scenes. We present RiskMV-DPO, a general and systematic pipeline for physically-informed, risk-controllable multi-view scenario generation. By integrating target risk levels with physically-grounded risk modeling, we synthesize diverse and high-stakes dynamic trajectories that serve as explicit geometric anchors for a diffusion-based video generator. To ensure spatial-temporal coherence and geometric fidelity, we introduce a geometry-appearance alignment module and a region-aware direct preference optimization (RA-DPO) strategy with motion-aware masking to focus learning on localized dynamic regions. Experiments on the nuScenes dataset show that RiskMV-DPO can freely generate a wide spectrum of diverse scenarios while maintaining visual quality, improving 3D detection mAP from 18.17 to 30.50 and reducing FID to 15.70. Our work shifts the role of world models from passive environment prediction to proactive, risk-controllable synthesis, providing a scalable toolchain for the development of embodied intelligence.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Generative simulation for driving, one of 9 directions in End-to-end autonomous driving. Builds on 25 of its 48 references that are in the map. First posted on arXiv 12 Mar 2026.

Builds on

25 of 48 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
  2. 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
  3. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep

Other references · 22

  1. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  3. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
  4. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
  5. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 165
  6. 2017On a Formal Model of Safe and Scalable Self-driving Carscited by 129
  7. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  8. 2024ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehiclescited by 92
  9. 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 90
  10. 2018Scenic: A Language for Scenario Specification and Scene Generationcited by 79
  11. 2019Adaptive Stress Testing for Autonomous Vehiclescited by 70
  12. 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Modelscited by 32
10 more
  1. 2021Criticality Metrics for Automated Driving: A Review and Suitability Analysis of the State of the Artcited by 30
  2. 2025DGGT: Feedforward 4D Reconstruction of Dynamic Driving Scenes using Unposed Imagescited by 21
  3. 2026VGGDrive: Empowering Vision-Language Models with Cross-View Geometric Grounding for Autonomous Drivingcited by 19
  4. 2025Text2Scenario: Text-Driven Scenario Generation for Autonomous Driving Testcited by 18
  5. 2025LLM-attacker: Enhancing Closed-loop Adversarial Scenario Generation for Autonomous Driving with Large Language Modelscited by 16
  6. 2024Seeing Beyond Views: Multi-View Driving Scene Video Generation with Holistic Attentioncited by 10
  7. 2024SafeDrive: Knowledge- and Data-Driven Risk-Sensitive Decision-Making for Autonomous Vehicles with Large Language Modelscited by 10
  8. 2025RiskNet: Interaction-Aware Risk Forecasting for Autonomous Driving in Long-Tail Scenarioscited by 4
  9. 2026Mind the Generative Details: Direct Localized Detail Preference Optimization for Video Diffusion Modelscited by 3
  10. 2025PriorFusion: Unified Integration of Priors for Robust Road Perception in Autonomous Drivingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025SafeMVDrive: Multi-view Safety-Critical Driving Video Synthesis in the Real World Domain
  2. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving
  3. 2025World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving
  4. 2026READ: Learning Risk-Informed Fields for End-to-End Autonomous Driving
  5. 2026UniDrive: A Unified Vision-Language and Grounding Framework for Interpretable Risk Understanding in Autonomous Driving
  6. 2023Scenario Diffusion: Controllable Driving Scenario Generation With Diffusion
  7. 2026Risk-Aware World Modeling with Flow-Guided Occupancy Evolution for Selective Trajectory Planning in Automated Driving
  8. 2026Controllable and Photorealistic Pedestrian Risky Motion Generation for End-to-End Driving Safety Evaluation