mlsanityData to 7 Oct 2026

ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation

arXiv 2312.02201 ↗First posted 2 Dec 2023cs.CVcited by 256

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We introduce "ImageDream," an innovative image-prompt, multi-view diffusion model for 3D object generation. ImageDream stands out for its ability to produce 3D models of higher quality compared to existing state-of-the-art, image-conditioned methods. Our approach utilizes a canonical camera coordination for the objects in images, improving visual geometry accuracy. The model is designed with various levels of control at each block inside the diffusion model based on the input image, where global control shapes the overall object layout and local control fine-tunes the image details. The effectiveness of ImageDream is demonstrated through extensive evaluations using a standard prompt list. For more information, visit our project page at https://Image-Dream.github.io.

Key facts. Cited by 256 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 47 of its 51 references that are in the map. First posted on arXiv 2 Dec 2023.

Builds on

47 of 51 references.

Closest ancestors · 23

Same direction, newest first

  1. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior25 Oct
  2. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  3. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  4. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models4 Oct
  5. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  6. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
  7. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation21 Jun
  8. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data13 Jun
  9. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  10. 2023TextMesh: Generation of Realistic 3D Meshes From Text Prompts24 Apr
  11. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models5 Apr
  12. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Images29 Mar
11 more
  1. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  2. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  4. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  5. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec
  6. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  7. 20223D Neural Field Generation using Triplane Diffusion30 Nov
  8. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Views29 Nov
  9. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  10. 2022Novel View Synthesis with Diffusion Models6 Oct
  11. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 24

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  4. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  5. 2013Auto-Encoding Variational Bayescited by 3,980
  6. 2016Improved Techniques for Training GANscited by 2,938
  7. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  8. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  9. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  11. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  12. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
12 more
  1. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  2. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  3. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  4. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
  5. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  6. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  7. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  8. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  9. 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
  10. 2023Multiview Compressive Coding for 3D Reconstructioncited by 71
  11. 2020Leveraging 2D Data to Learn Textured 3D Mesh Generationcited by 69
  12. 2019Learning single-image 3D reconstruction by generative modelling of shape, pose and shadingcited by 43

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 118; 2025: 104; 2026: 32.

256 papers.

Sort:

By area:

  1. 2025Qwen-Image Technical Reportcited by 973
  2. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  3. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  4. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  5. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  6. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 214
  7. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  8. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  9. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
  10. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
  11. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  12. 2024Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformerscited by 137
38 more
  1. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  2. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  3. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 130
  4. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  5. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  6. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  7. 20243DTopia-XL: Scaling High-quality 3D Asset Generation via Primitive Diffusioncited by 100
  8. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
  9. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 99
  10. 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstructioncited by 94
  11. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 91
  12. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
  13. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  14. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
  15. 2024Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materialscited by 66
  16. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  17. 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 62
  18. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 62
  19. 2024SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfercited by 61
  20. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
  21. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  22. 2024VFusion3D: Learning Scalable 3D Generative Models from Video Diffusion Modelscited by 56
  23. 2024Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstructioncited by 56
  24. 2024Animate3D: Animating Any 3D Model with Multi-view Video Diffusioncited by 55
  25. 2024MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Modelcited by 55
  26. 2024HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priorscited by 54
  27. 2024Fast Feedforward 3D Gaussian Splatting Compressioncited by 49
  28. 2024GenXD: Generating Any 3D and 4D Scenescited by 49
  29. 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 49
  30. 20254DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videoscited by 46
  31. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
  32. 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
  33. 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 44
  34. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
  35. 2025Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attentioncited by 43
  36. 2024One Diffusion to Generate Them Allcited by 41
  37. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  38. 2025Matrix3D: Large Photogrammetry Model All-in-Onecited by 39

50 most cited of 256 All 256 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024Multi-view Image Prompted Multi-view Diffusion for Improved 3D Generation
  2. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image
  3. 2023DreamComposer: Controllable 3D Object Generation via Multi-View Conditions
  4. 2023State of the Art on Diffusion Models for Visual Computing
  5. 2023Generating Images with 3D Annotations Using Diffusion Models
  6. 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
  7. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
  8. 2024Diffusion Models in 3D Vision: A Survey