mlsanityData to 14 Oct 2026

3D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation

arXiv 2410.18974 ↗First posted 24 Oct 2024cs.CV cs.AIcited by 19

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Multi-view image diffusion models have significantly advanced open-domain 3D object generation. However, most existing models rely on 2D network architectures that lack inherent 3D biases, resulting in compromised geometric consistency. To address this challenge, we introduce 3D-Adapter, a plug-in module designed to infuse 3D geometry awareness into pretrained image diffusion models. Central to our approach is the idea of 3D feedback augmentation: for each denoising step in the sampling loop, 3D-Adapter decodes intermediate multi-view features into a coherent 3D representation, then re-encodes the rendered RGBD views to augment the pretrained base model through feature addition. We study two variants of 3D-Adapter: a fast feed-forward version based on Gaussian splatting and a versatile training-free version utilizing neural fields and meshes. Our extensive experiments demonstrate that 3D-Adapter not only greatly enhances the geometry quality of text-to-multi-view models such as Instant3D and Zero123++, but also enables high-quality 3D generation using the plain text-to-image Stable Diffusion. Furthermore, we showcase the broad application potential of 3D-Adapter by presenting high quality results in text-to-3D, image-to-3D, text-to-texture, and text-to-avatar tasks.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 85 of its 94 references that are in the map. First posted on arXiv 24 Oct 2024.

Builds on

85 of 94 references.

Closest ancestors · 28

Same direction, newest first

  1. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle28 Jul
  2. 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models27 May
  3. 2024TexPainter: Generative Mesh Texturing with Multi-view Consistency17 May
  4. 2024GenesisTex: Adapting Image Denoising Diffusion to Texture Space26 Mar
  5. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
  6. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors4 Mar
  7. 2023Carve3D: Improving Multi-view Reconstruction Consistency for Diffusion Models with RL Finetuning21 Dec
  8. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models21 Dec
  9. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion11 Dec
  10. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion14 Nov
  11. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
  12. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
16 more
  1. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  2. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  3. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  4. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
  5. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  6. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction13 Apr
  7. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
  8. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  9. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation9 Mar
  10. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  11. 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec
  12. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec
  13. 20223D Neural Field Generation using Triplane Diffusion30 Nov
  14. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation17 Nov
  15. 2022Novel View Synthesis with Diffusion Models6 Oct
  16. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 57

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022Classifier-Free Diffusion Guidancecited by 5,847
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  11. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  12. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
38 more
  1. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  2. 2022Video Diffusion Modelscited by 2,305
  3. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  4. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  5. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  6. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  7. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  8. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  9. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  10. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  11. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  12. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  13. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  14. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  15. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  16. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  17. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  18. 20218-bit Optimizers via Block-wise Quantizationcited by 403
  19. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  20. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  21. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 232
  22. 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
  23. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
  24. 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
  25. 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 182
  26. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
  27. 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 177
  28. 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
  29. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  30. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  31. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
  32. 2023State of the Art on Diffusion Models for Visual Computingcited by 127
  33. 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
  34. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  35. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  36. 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
  37. 2024Classifier-Free Guidance is a Predictor-Correctorcited by 84
  38. 2023Free3D: Consistent Novel View Synthesis without 3D Representationcited by 72

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 9.

19 papers.

Sort:

By area:

  1. 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generationcited by 48
  2. 2025Parameter-Efficient Fine-Tuning for Foundation Modelscited by 45
  3. 2025Dress-1-to-3: Single Image to Simulation-Ready 3D Outfit with Diffusion Prior and Differentiable Physicscited by 20
  4. 2025Pro3D-Editor : A Progressive-Views Perspective for Consistent and Precise 3D Editingcited by 11
  5. 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Trainingcited by 7
  6. 2024Sharp-It: A Multi-view to Multi-view Diffusion Model for 3D Synthesis and Manipulationcited by 6
  7. 2025Advancing high-fidelity 3D and Texture Generation with 2.5D latentscited by 5
  8. 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
  9. 2024DSplats: 3D Generation by Denoising Splats-Based Multiview Diffusion Modelscited by 2
  10. 2025AlignCVC: Aligning Cross-View Consistency for Single-Image-to-3D Generationcited by 2
  11. 2025Track, Inpaint, Resplat: Subject-driven 3D and 4D Generation with Progressive Texture Infillingcited by 2
  12. 2026MOC-3D: Manifold-Order Consistency for Text-to-3D Generationcited by 2
7 more
  1. 2026GeoFlow: Enforcing Implicit Geometric Consistency in Video Generationcited by 2
  2. 2026AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splattingcited by 1
  3. 20263DCarGen: Scalable 3D Car Generation via 3D-consistent Multi-view Synthesiscited by 1
  4. 2026Towards Realistic and Consistent Orbital Video Generation via 3D Foundation Priorscited by 0
  5. 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Controlcited by 0
  6. 2026PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learningcited by 0
  7. 2026ORCA: Occlusion-Aware Refinement and Completion for Novel View Synthesiscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy
  2. 2024Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors
  3. 2024Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior
  4. 2024V3D: Video Diffusion Models are Effective 3D Generators
  5. 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis
  6. 2025Geometry and Perception Guided Gaussians for Multiview-consistent 3D Generation from a Single Image
  7. 2026Leveling3D: Leveling Up 3D Reconstruction with Feed-Forward 3D Gaussian Splatting and Geometry-Aware Generation
  8. 2023GeoDream: Disentangling 2D and Geometric Priors for High-Fidelity and Consistent 3D Generation