mlsanityData to 7 Oct 2026

IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generation

arXiv 2402.08682 ↗First posted 13 Feb 2024cs.CV cs.AI cs.LGcited by 84

Not on the map. Why?

Cited by 34 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Most text-to-3D generators build upon off-the-shelf text-to-image models trained on billions of images. They use variants of Score Distillation Sampling (SDS), which is slow, somewhat unstable, and prone to artifacts. A mitigation is to fine-tune the 2D generator to be multi-view aware, which can help distillation or can be combined with reconstruction networks to output 3D objects directly. In this paper, we further explore the design space of text-to-3D models. We significantly improve multi-view generation by considering video instead of image generators. Combined with a 3D reconstruction algorithm which, by using Gaussian splatting, can optimize a robust image-based loss, we directly produce high-quality 3D outputs from the generated views. Our new method, IM-3D, reduces the number of evaluations of the 2D generator network 10-100x, resulting in a much more efficient pipeline, better quality, fewer geometric inconsistencies, and higher yield of usable 3D assets.

Key facts. Cited by 84 papers in the map (data through 7 Oct 2026). Builds on 51 of its 58 references that are in the map. First posted on arXiv 13 Feb 2024.

Builds on

51 of 58 references.

References · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  8. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  11. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  12. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
38 more
  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  2. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  3. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  4. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  5. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  6. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  7. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  8. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  9. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  10. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  11. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  12. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
  13. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  14. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  15. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  16. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  17. 2023Text-to-3D using Gaussian Splattingcited by 299
  18. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
  19. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
  20. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  21. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
  22. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  23. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  24. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Datacited by 113
  25. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  26. 2022Highly Accurate Dichotomous Image Segmentationcited by 110
  27. 2023Noise-Free Score Distillationcited by 99
  28. 2023ATT3D: Amortized Text-to-3D Object Synthesiscited by 87
  29. 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesiscited by 84
  30. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
  31. 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
  32. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 57
  33. 2024AGG: Amortized Generative 3D Gaussians for Single Image to 3Dcited by 51
  34. 2023HiFi-123: Towards High-fidelity One Image to 3D Content Generationcited by 34
  35. 2023Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Viewscited by 32
  36. 2023Collaborative Score Distillation for Consistent Visual Synthesiscited by 23
  37. 2023SteinDreamer: Variance Reduction for Text-to-3D Score Distillation via Stein Identitycited by 23
  38. 2024HexaGen3D: StableDiffusion is just one step away from Fast and Diverse Text-to-3D Generationcited by 21

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 45; 2025: 32; 2026: 7.

84 papers.

Sort:

By area:

  1. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  2. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 163
  3. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
  4. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  5. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  6. 2024Training-free Camera Control for Video Generationcited by 119
  7. 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 113
  8. 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
  9. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  10. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
  11. 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
  12. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
38 more
  1. 20243D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunitiescited by 77
  2. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  3. 2024SF3D: Stable Fast 3D Mesh Reconstruction with UV-unwrapping and Illumination Disentanglementcited by 65
  4. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  5. 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
  6. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  7. 2024GenXD: Generating Any 3D and 4D Scenescited by 49
  8. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  9. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
  10. 2024Score Distillation via Reparametrized DDIMcited by 41
  11. 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39
  12. 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
  13. 2024GAF: Gaussian Avatar Reconstruction from Monocular Videos via Multi-view Diffusioncited by 36
  14. 2024Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesiscited by 33
  15. 2024Ouroboros3D: Image-to-3D Generation via 3D-aware Recursive Diffusioncited by 31
  16. 2024MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Modelcited by 31
  17. 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
  18. 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
  19. 2025SynCity: Training-Free Generation of 3D Worldscited by 30
  20. 2024Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamicscited by 28
  21. 2024Cavia: Camera-controllable Multi-view Video Diffusion with View-Integrated Attentioncited by 24
  22. 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 24
  23. 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
  24. 2025WorldGen: From Text to Traversable and Interactive 3D Worldscited by 18
  25. 2025UnCommon Objects in 3Dcited by 17
  26. 2025Skyfall-GS: Synthesizing Immersive 3D Urban Scenes from Satellite Imagerycited by 16
  27. 2025Zero4D: Training-Free 4D Video Generation From Single Video Using Off-the-Shelf Video Diffusioncited by 15
  28. 2025Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generationcited by 14
  29. 2025Simulating the Real World: A Unified Survey of Multimodal Generative Modelscited by 14
  30. 2024Lightplane: Highly-Scalable Components for Neural 3D Fieldscited by 13
  31. 2024Flex3D: Feed-Forward 3D Generation with Flexible Reconstruction Model and Input View Curationcited by 12
  32. 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Modelscited by 12
  33. 2024LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priorscited by 11
  34. 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehiclescited by 10
  35. 2025Gen3DEval: Using vLLMs for Automatic Evaluation of Generated 3D Objectscited by 10
  36. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Priorcited by 10
  37. 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Imagecited by 10
  38. 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priorscited by 9

50 most cited of 84 All 84 (JSON)