mlsanityData to 7 Oct 2026

DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model

arXiv 2410.12928 ↗First posted 16 Oct 2024cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

We introduce DreamCraft3D++, an extension of DreamCraft3D that enables efficient high-quality generation of complex 3D assets. DreamCraft3D++ inherits the multi-stage generation process of DreamCraft3D, but replaces the time-consuming geometry sculpting optimization with a feed-forward multi-plane based reconstruction model, speeding up the process by 1000x. For texture refinement, we propose a training-free IP-Adapter module that is conditioned on the enhanced multi-view images to enhance texture and geometry consistency, providing a 4x faster alternative to DreamCraft3D's DreamBooth fine-tuning. Experiments on diverse datasets demonstrate DreamCraft3D++'s ability to generate creative 3D assets with intricate geometry and realistic 360deg textures, outperforming state-of-the-art image-to-3D methods in quality and speed. The full implementation will be open-sourced to enable new possibilities in 3D content creation.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 84 of its 92 references that are in the map. First posted on arXiv 16 Oct 2024.

Builds on

84 of 92 references.

References · 84

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
  1. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  5. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  6. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  7. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  8. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  9. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  10. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  11. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  12. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  13. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  14. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  15. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  16. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  17. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  18. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  19. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  20. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  21. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  22. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  23. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  24. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  25. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  26. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 421
  27. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  28. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  29. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  30. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  31. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  32. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
  33. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  34. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  35. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
  36. 2022Novel View Synthesis with Diffusion Modelscited by 299
  37. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  38. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287

50 most cited of 84 All 84 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 6.

7 papers.

  1. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  2. 2024DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flowcited by 8
  3. 2025PlantDreamer: Achieving Realistic 3D Plant Models with Diffusion-Guided Gaussian Splattingcited by 3
  4. 2025FlexAvatar: Flexible Large Reconstruction Model for Animatable Gaussian Head Avatars with Detailed Deformationcited by 2
  5. 2025MoReMouse: Monocular Reconstruction of Laboratory Mousecited by 1
  6. 2025GSPlane: Concise and Accurate Planar Reconstruction via Structured Representationcited by 1
  7. 2025CADMorph: Geometry-Driven Parametric CAD Editing via a Plan-Generate-Verify Loopcited by 0