Enhancing Monocular 3D Scene Completion with Diffusion Model
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
3D scene reconstruction is essential for applications in virtual reality, robotics, and autonomous driving, enabling machines to understand and interact with complex environments. Traditional 3D Gaussian Splatting techniques rely on images captured from multiple viewpoints to achieve optimal performance, but this dependence limits their use in scenarios where only a single image is available. In this work, we introduce FlashDreamer, a novel approach for reconstructing a complete 3D scene from a single image, significantly reducing the need for multi-view inputs. Our approach leverages a pre-trained vision-language model to generate descriptive prompts for the scene, guiding a diffusion model to produce images from various perspectives, which are then fused to form a cohesive 3D reconstruction. Extensive experiments show that our method effectively and robustly expands single-image inputs into a comprehensive 3D scene, extending monocular 3D reconstruction capabilities without further training. Our code is available https://github.com/CharlieSong1999/FlashDreamer/tree/main.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 27 of its 34 references that are in the map. First posted on arXiv 2 Mar 2025.
Builds on
27 of 34 references.
References · 27
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024The Llama 3 Herd of Modelscited by 14,192
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Video Diffusion Modelscited by 2,280
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
15 more
- 2023Gaussian Splatting SLAMcited by 410
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2023LEDITS++: Limitless Image Editing using Text-to-Image Modelscited by 147
- 2023Distilled Feature Fields Enable Few-Shot Language-Guided Manipulationcited by 130
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
- 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 113
- 20243D Gaussian as a New Era: A Surveycited by 102
- 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
- 2024Large Spatial Model: End-to-end Unposed Images to Semantic 3Dcited by 73
- 2024FastScene: Text-Driven Fast 3D Indoor Scene Generation via Panoramic Gaussian Splattingcited by 24
- 2024SceneDreamer360: Text-Driven 3D-Consistent Scene Generation with Panoramic Gaussian Splattingcited by 24
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Images
- 2024Wonderland: Navigating 3D Scenes from a Single Image
- 2024Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses
- 2025Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Model
- 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
- 2024Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors
- 2024Diffusion Models in 3D Vision: A Survey
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation