MD-ProjTex: Texturing 3D Shapes with Multi-Diffusion Projection
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We introduce MD-ProjTex, a method for fast and consistent text-guided texture generation for 3D shapes using pretrained text-to-image diffusion models. At the core of our approach is a multi-view consistency mechanism in UV space, which ensures coherent textures across different viewpoints. Specifically, MD-ProjTex fuses noise predictions from multiple views at each diffusion step and jointly updates the per-view denoising directions to maintain 3D consistency. In contrast to existing state-of-the-art methods that rely on optimization or sequential view synthesis, MD-ProjTex is computationally more efficient and achieves better quantitative and qualitative results.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 49 of its 55 references that are in the map. First posted on arXiv 3 Apr 2025.
Builds on
49 of 55 references.
Closest ancestors · 12
Same direction, newest first
- 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling2 Aug
- 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models27 May
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistency17 May
- 2023Carve3D: Improving Multi-view Reconstruction Consistency for Diffusion Models with RL Finetuning21 Dec
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models21 Dec
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion11 Dec
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
- 2023Texture Generation on 3D Meshes with Point-UV Diffusion21 Aug
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
- 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 37
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
25 more
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 536
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2019GANFIT: Generative Adversarial Network Fitting for High Fidelity 3D Face Reconstructioncited by 150
- 2020AvatarMe: Realistically Renderable 3D Facial Reconstruction "in-the-wild"cited by 91
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2024IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generationcited by 84
- 2023Free3D: Consistent Novel View Synthesis without 3D Representationcited by 72
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2019HoloGAN: Unsupervised learning of 3D representations from natural imagescited by 59
- 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
- 2019Predicting 3D Human Dynamics from Videocited by 51
- 2022Fine Detailed Texture Learning for 3D Meshes with Generative Modelscited by 15
- 2023Progressive Learning of 3D Reconstruction Network from 2D GAN Datacited by 10
- 2023Refining 3D Human Texture Estimation from a Single Imagecited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024GenesisTex: Adapting Image Denoising Diffusion to Texture Space
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusion
- 2024GenesisTex2: Stable, Consistent and High-Quality Text-to-Texture Generation
- 2024RoCoTex: A Robust Method for Consistent Texture Synthesis with Diffusion Models
- 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
- 2024An Optimization Framework to Enforce Multi-View Consistency for Texturing 3D Meshes
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models
- 2023Text-guided High-definition Consistency Texture Model