mlsanityData to 14 Oct 2026

MVDream: Multi-view Diffusion for 3D Generation

arXiv 2308.16512 ↗First posted 31 Aug 2023cs.CVcited by 938

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We introduce MVDream, a diffusion model that is able to generate consistent multi-view images from a given text prompt. Learning from both 2D and 3D data, a multi-view diffusion model can achieve the generalizability of 2D diffusion models and the consistency of 3D renderings. We demonstrate that such a multi-view diffusion model is implicitly a generalizable 3D prior agnostic to 3D representations. It can be applied to 3D generation via Score Distillation Sampling, significantly enhancing the consistency and stability of existing 2D-lifting methods. It can also learn new concepts from a few 2D examples, akin to DreamBooth, but for 3D generation.

Key facts. Cited by 938 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 48 of its 55 references that are in the map. First posted on arXiv 31 Aug 2023.

Builds on

48 of 55 references.

Closest ancestors · 16

Same direction, newest first

  1. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation21 Jun
  2. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data13 Jun
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  4. 2023TextMesh: Generation of Realistic 3D Meshes From Text Prompts24 Apr
  5. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr
  6. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Images29 Mar
  7. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  8. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  9. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  10. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  11. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec
  12. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
4 more
  1. 20223D Neural Field Generation using Triplane Diffusion30 Nov
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  3. 2022Novel View Synthesis with Diffusion Models6 Oct
  4. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 32

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  10. 2016Improved Techniques for Training GANscited by 2,970
  11. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
20 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  2. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  3. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  5. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  6. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  7. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  8. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  9. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  10. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  11. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  12. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  13. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  14. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  15. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  16. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 212
  17. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  18. 2023Multiview Compressive Coding for 3D Reconstructioncited by 71
  19. 2020Leveraging 2D Data to Learn Textured 3D Mesh Generationcited by 69
  20. 2019Learning single-image 3D reconstruction by generative modelling of shape, pose and shadingcited by 43

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 90; 2024: 377; 2025: 297; 2026: 174.

938 papers.

Sort:

By area:

  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  2. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  3. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  4. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  5. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  6. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  7. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  8. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 566
  9. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  10. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  11. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  12. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
38 more
  1. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
  2. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  3. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  4. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  5. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  6. 2023Text-to-3D using Gaussian Splattingcited by 299
  7. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  8. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
  9. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 286
  10. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  11. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  12. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  13. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  14. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  15. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  16. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  17. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  18. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 189
  19. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
  20. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
  21. 2024Probing the 3D Awareness of Visual Foundation Modelscited by 177
  22. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  23. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  24. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  25. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
  26. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  27. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  28. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  29. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  30. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
  31. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
  32. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
  33. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
  34. 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Modelcited by 143
  35. 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 140
  36. 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
  37. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
  38. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134

50 most cited of 938 All 938 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generation
  2. 2024PlacidDreamer: Advancing Harmony in Text-to-3D Generation
  3. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation
  4. 2024MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusion
  5. 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation
  6. 2023EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Prior
  7. 20233D-aware Image Generation using 2D Diffusion Models
  8. 2025DreamComposer++: Empowering Diffusion Models with Multi-View Conditions for 3D Content Generation