mlsanityData to 14 Oct 2026

WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generation

arXiv 2312.02934 ↗First posted 5 Dec 2023cs.CVcited by 93

Not on the map. Why?

Cited by 46 in End-to-end autonomous driving, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Generating multi-camera street-view videos is critical for augmenting autonomous driving datasets, addressing the urgent demand for extensive and varied data. Due to the limitations in diversity and challenges in handling lighting conditions, traditional rendering-based methods are increasingly being supplanted by diffusion-based methods. However, a significant challenge in diffusion-based methods is ensuring that the generated sensor data preserve both intra-world consistency and inter-sensor coherence. To address these challenges, we combine an additional explicit world volume and propose the World Volume-aware Multi-camera Driving Scene Generator (WoVoGen). This system is specifically designed to leverage 4D world volume as a foundational element for video generation. Our model operates in two distinct phases: (i) envisioning the future 4D temporal world volume based on vehicle control sequences, and (ii) generating multi-camera videos, informed by this envisioned 4D temporal world volume and sensor interconnectivity. The incorporation of the 4D world volume empowers WoVoGen not only to generate high-quality street-view videos in response to vehicle control inputs but also to facilitate scene editing tasks.

Key facts. Cited by 93 papers in the map (data through 14 Oct 2026). Builds on 48 of its 53 references that are in the map. First posted on arXiv 5 Dec 2023.

Builds on

48 of 53 references.

References · 48

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2020Denoising Diffusion Implicit Modelscited by 9,781
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2017Squeeze-and-Excitation Networkscited by 4,789
  11. 2017Neural Discrete Representation Learningcited by 4,712
  12. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
36 more
  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  2. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  3. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  4. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
  6. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  7. 2022BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformerscited by 1,218
  8. 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
  9. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
  10. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  11. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
  12. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  13. 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
  14. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
  15. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  16. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  17. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
  18. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  19. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Drivingcited by 319
  20. 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
  21. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  22. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
  23. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
  24. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  25. 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 213
  26. 2023Scene as Occupancycited by 209
  27. 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
  28. 2021Panoptic nuScenes: A Large-Scale Benchmark for LiDAR Panoptic Segmentation and Trackingcited by 166
  29. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  30. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  31. 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
  32. 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
  33. 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
  34. 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
  35. 2023NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Modelscited by 76
  36. 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 25; 2025: 41; 2026: 26.

93 papers.

Sort:

By area:

  1. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  2. 2024GenAD: Generalized Predictive Model for Autonomous Drivingcited by 150
  3. 2025Epona: Autoregressive Diffusion World Model for Autonomous Drivingcited by 117
  4. 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
  5. 2024UniScene: Unified Occupancy-centric Driving Scene Generationcited by 106
  6. 2024GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Controlcited by 78
  7. 20253D and 4D World Modeling: A Surveycited by 67
  8. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPTcited by 66
  9. 2025A Survey of World Models for Autonomous Drivingcited by 60
  10. 2024InfiniCube: Unbounded and Controllable Dynamic 3D Driving Scene Generation with World-Guided Video Modelscited by 56
  11. 2025HERMES: A Unified Self-Driving World Model for Simultaneous 3D Scene Understanding and Generationcited by 56
  12. 2024Sora as a World Model? A Complete Survey on Text-to-Video Generationcited by 53
38 more
  1. 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 53
  2. 2024Doe-1: Closed-Loop Autonomous Driving with Large World Modelcited by 51
  3. 2025DriveLaW:Unifying Planning and Video Generation in a Latent Driving Worldcited by 47
  4. 2026DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generationcited by 45
  5. 2025ReSim: Reliable World Simulation for Autonomous Drivingcited by 44
  6. 2025DiST-4D: Disentangled Spatiotemporal Diffusion with Metric Depth for 4D Driving Scene Generationcited by 40
  7. 2025Foundation Models in Autonomous Driving: A Survey on Scenario Generation and Scenario Analysiscited by 38
  8. 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenescited by 35
  9. 2024SimGen: Simulator-conditioned Driving Scene Generationcited by 34
  10. 2025OmniNWM: Omniscient Driving Navigation World Modelscited by 33
  11. 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
  12. 2024SubjectDrive: Scaling Generative Data in Autonomous Driving via Subject Controlcited by 32
  13. 2024A Survey on Data Augmentation in Large Model Eracited by 31
  14. 2023Towards Knowledge-driven Autonomous Drivingcited by 29
  15. 2024Vision-based 3D occupancy prediction in autonomous driving: a review and outlookcited by 29
  16. 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Surveycited by 29
  17. 2025Exploring the Roles of Large Language Models in Reshaping Transportation Systems: A Survey, Framework, and Roadmapcited by 26
  18. 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Drivingcited by 25
  19. 20253D Scene Generation: A Surveycited by 24
  20. 2025A Survey of Interactive Generative Videocited by 23
  21. 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 22
  22. 2025Genesis: Multimodal Driving Scene Generation with Spatio-Temporal and Cross-Modal Consistencycited by 22
  23. 2024BEVWorld: A Multimodal World Simulator for Autonomous Driving via Scene-Level BEV Latentscited by 21
  24. 2024InfinityDrive: Breaking Time Limits in Driving World Modelscited by 21
  25. 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
  26. 2025GeoDrive: 3D Geometry-Informed Driving World Model with Precise Action Controlcited by 19
  27. 2025MiLA: Multi-view Intensive-fidelity Long-term Video Generation World Model for Autonomous Drivingcited by 18
  28. 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perceptioncited by 16
  29. 2024SyntheOcc: Synthesize Geometric-Controlled Street View Images through 3D Semantic MPIscited by 14
  30. 2024X-Drive: Cross-modality consistent multi-sensor data synthesis for driving scenarioscited by 14
  31. 2025Rethinking Driving World Model as Synthetic Data Generator for Perception Taskscited by 14
  32. 2024Physical Informed Driving World Modelcited by 13
  33. 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Modelscited by 13
  34. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representationcited by 13
  35. 2026CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Drivingcited by 12
  36. 2024Driving View Synthesis on Free-form Trajectories with Generative Priorcited by 11
  37. 2025GenieDrive: Towards Physics-Aware Driving World Model with 4D Occupancy Guided Video Generationcited by 11
  38. 2026Uni-World VLA: Interleaved World Modeling and Planning for Autonomous Drivingcited by 11

50 most cited of 93 All 93 (JSON)