mlsanityData to 7 Oct 2026

WonderWorld: Interactive 3D Scene Generation from a Single Image

arXiv 2406.09394 ↗First posted 13 Jun 2024cs.CV cs.GRcited by 197

Not on the map. Why?

Cited by 41 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present WonderWorld, a novel framework for interactive 3D scene generation that enables users to interactively specify scene contents and layout and see the created scenes in low latency. The major challenge lies in achieving fast generation of 3D scenes. Existing scene generation approaches fall short of speed as they often require (1) progressively generating many views and depth maps, and (2) time-consuming optimization of the scene geometry representations. We introduce the Fast Layered Gaussian Surfels (FLAGS) as our scene representation and an algorithm to generate it from a single view. Our approach does not need multiple views, and it leverages a geometry-based initialization that significantly reduces optimization time. Another challenge is generating coherent geometry that allows all scenes to be connected. We introduce the guided depth diffusion that allows partial conditioning of depth estimation. WonderWorld generates connected and diverse 3D scenes in less than 10 seconds on a single A6000 GPU, enabling real-time user interaction and exploration. We demonstrate the potential of WonderWorld for user-driven content creation and exploration in virtual environments. We release full code and software for reproducibility. Project website: https://kovenyu.com/WonderWorld/.

Key facts. Cited by 197 papers in the map (data through 7 Oct 2026). Builds on 60 of its 75 references that are in the map. First posted on arXiv 13 Jun 2024.

Builds on

60 of 75 references.

References · 60

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023Segment Anythingcited by 8,158
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  8. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  9. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  10. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  11. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  12. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
38 more
  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  2. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  3. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  4. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  5. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  6. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  7. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  8. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  9. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  10. 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 327
  11. 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
  12. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  13. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
  14. 2020Single-View View Synthesis with Multiplane Imagescited by 263
  15. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  16. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
  17. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  18. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  19. 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
  20. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  21. 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 159
  22. 2023WonderJourney: Going from Anywhere to Everywherecited by 157
  23. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  24. 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
  25. 20193D Ken Burns Effect from a Single Imagecited by 128
  26. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
  27. 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 113
  28. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  29. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  30. 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
  31. 2018Layer-structured 3D Scene Inference via View Synthesiscited by 82
  32. 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
  33. 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
  34. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
  35. 2020Worldsheet: Wrapping the World in a 3D Sheet for View Synthesis from a Single Imagecited by 77
  36. 2023Long-Term Photometric Consistent Novel View Synthesis with Diffusion Modelscited by 76
  37. 2022Perspective Fields for Single Image Camera Calibrationcited by 75
  38. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 16; 2025: 95; 2026: 86.

197 papers.

Sort:

By area:

  1. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
  2. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 161
  3. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 152
  4. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modelingcited by 152
  5. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 143
  6. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
  7. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 102
  8. 2024Wonderland: Navigating 3D Scenes from a Single Imagecited by 98
  9. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  10. 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 93
  11. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  12. 2025TesserAct: Learning 4D Embodied World Modelscited by 90
38 more
  1. 2025RELIC: Interactive Video World Model with Long-Horizon Memorycited by 89
  2. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 86
  3. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  4. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 65
  5. 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
  6. 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
  7. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  8. 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 47
  9. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  10. 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
  11. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 43
  12. 2024VistaDream: Sampling multiview consistent images for single-view scene reconstructioncited by 38
  13. 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Cameracited by 38
  14. 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
  15. 2024Prometheus: 3D-Aware Latent Diffusion Models for Feed-Forward Text-to-3D Scene Generationcited by 33
  16. 2025Matrix-3D: Omnidirectional Explorable 3D World Generationcited by 33
  17. 2025FantasyWorld: Geometry-Consistent World Modeling via Unified Video and 3D Predictioncited by 33
  18. 2025Spatia: Video Generation with Updatable Spatial Memorycited by 33
  19. 2025Depth Anything with Any Priorcited by 32
  20. 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Modelcited by 31
  21. 2025WonderTurbo: Generating Interactive 3D World in 0.72 Secondscited by 31
  22. 2025SynCity: Training-Free Generation of 3D Worldscited by 30
  23. 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 30
  24. 2024DepthLab: From Partial to Completecited by 27
  25. 2025ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediarycited by 27
  26. 2025WorldExplorer: Towards Generating Fully Navigable 3D Scenescited by 26
  27. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 26
  28. 2024DynamicScaler: Seamless and Scalable Video Generation for Panoramic Scenescited by 24
  29. 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 24
  30. 2025AuraFusion360: Augmented Unseen Region Alignment for Reference-based 360deg Unbounded Scene Inpaintingcited by 21
  31. 2024GenEx: Generating an Explorable Worldcited by 20
  32. 2025X-Scene: Large-Scale Driving Scene Generation with High Fidelity and Flexible Controllabilitycited by 20
  33. 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenescited by 19
  34. 2025A Survey on 3D Gaussian Splatting Applications: Segmentation, Editing, and Generationcited by 19
  35. 2025Sharp Monocular View Synthesis in Less Than a Secondcited by 19
  36. 2025HiScene: Creating Hierarchical 3D Scenes with Isometric View Generationcited by 18
  37. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 18
  38. 2025NeuralOS: Towards Simulating Operating Systems via Neural Generative Modelscited by 17

50 most cited of 197 All 197 (JSON)