mlsanityData to 7 Oct 2026

DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model

arXiv 2311.09217 ↗First posted 15 Nov 2023cs.CVcited by 213

Not on the map. Why?

Cited by 75 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We propose DMV3D, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise noisy multi-view images via NeRF reconstruction and rendering, achieving single-stage 3D generation in ~30s on single A100 GPU. We train DMV3D on large-scale multi-view image datasets of highly diverse objects using only image reconstruction losses, without accessing 3D assets. We demonstrate state-of-the-art results for the single-image reconstruction problem where probabilistic modeling of unseen object parts is required for generating diverse reconstructions with sharp textures. We also show high-quality text-to-3D generation results outperforming previous 3D diffusion models. Our project website is at: https://justimyhxu.github.io/projects/dmv3d/ .

Key facts. Cited by 213 papers in the map (data through 7 Oct 2026). Builds on 72 of its 77 references that are in the map. First posted on arXiv 15 Nov 2023.

Builds on

72 of 77 references.

References · 72

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2023Segment Anythingcited by 8,158
  10. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  11. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  12. 2022Scalable Diffusion Models with Transformerscited by 5,931
38 more
  1. 2022Classifier-Free Diffusion Guidancecited by 5,717
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  7. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  8. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  9. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  10. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  11. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  13. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  14. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  15. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  16. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  17. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  18. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  19. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  20. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  21. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  22. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  23. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  24. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  25. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  26. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  27. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  28. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  29. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  30. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  31. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  32. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  33. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  34. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  35. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  36. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  37. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  38. 2021Advances in Neural Renderingcited by 365

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 127; 2025: 66; 2026: 13.

213 papers.

Sort:

By area:

  1. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  2. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  3. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  4. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  5. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  6. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  7. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  8. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
  9. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
  10. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  11. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  12. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
38 more
  1. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
  2. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  3. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  4. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  5. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  6. 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
  7. 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 111
  8. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  9. 20243D Gaussian as a New Era: A Surveycited by 102
  10. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  11. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
  12. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
  13. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
  14. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
  15. 2024LLaMA-Mesh: Unifying 3D Mesh Generation with Language Modelscited by 87
  16. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 84
  17. 2024BlockFusion: Expandable 3D Scene Generation using Latent Tri-plane Extrapolationcited by 81
  18. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
  19. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 76
  20. 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
  21. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
  22. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  23. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  24. 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
  25. 2024Advances in 3D Generation: A Surveycited by 62
  26. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
  27. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  28. 2024GaussianObject: High-Quality 3D Object Reconstruction from Four Views with Gaussian Splattingcited by 59
  29. 2024Learning the 3D Fauna of the Webcited by 58
  30. 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
  31. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  32. 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
  33. 2024SCube: Instant Large-Scale Scene Reconstruction using VoxSplatscited by 56
  34. 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
  35. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  36. 2024LaRa: Efficient Large-Baseline Radiance Fieldscited by 54
  37. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  38. 2024Director3D: Real-world Camera Trajectory and 3D Scene Generation from Textcited by 50

50 most cited of 213 All 213 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2022NeRDi: Single-View NeRF Synthesis with Language-Guided Diffusion as General Image Priors
  2. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle
  3. 2024MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusion
  4. 2024MVDiff: Scalable and Flexible Multi-View Diffusion for 3D Object Reconstruction from Single-View
  5. 2024Diffusion2: Dynamic 3D Content Generation via Score Composition of Video and Multi-view Diffusion Models
  6. 2024Generative Lifting of Multiview to 3D from Unknown Pose: Wrapping NeRF inside Diffusion
  7. 2023MVDD: Multi-View Depth Diffusion Models
  8. 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models