mlsanityData to 7 Oct 2026

Texture Generation on 3D Meshes with Point-UV Diffusion

arXiv 2308.10490 ↗First posted 21 Aug 2023cs.CV cs.AI cs.GRcited by 63

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

In this work, we focus on synthesizing high-quality textures on 3D meshes. We present Point-UV diffusion, a coarse-to-fine pipeline that marries the denoising diffusion model with UV mapping to generate 3D consistent and high-quality texture images in UV space. We start with introducing a point diffusion model to synthesize low-frequency texture components with our tailored style guidance to tackle the biased color distribution. The derived coarse texture offers global consistency and serves as a condition for the subsequent UV diffusion stage, aiding in regularizing the model to generate a 3D consistent UV texture image. Then, a UV diffusion model with hybrid conditions is developed to enhance the texture fidelity in the 2D UV space. Our method can process meshes of any genus, generating diversified, geometry-compatible, and high-fidelity textures. Code is available at https://cvmi-lab.github.io/Point-UV-Diffusion

Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 48 of its 57 references that are in the map. First posted on arXiv 21 Aug 2023.

Builds on

48 of 57 references.

Closest ancestors · 5

Same direction, newest first

  1. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  3. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation17 Nov
  4. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  5. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  10. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  11. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  12. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
31 more
  1. 2017Improved Training of Wasserstein GANscited by 2,223
  2. 2018Demystifying MMD GANscited by 1,268
  3. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  4. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  5. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  6. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  7. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  8. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  9. 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
  10. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  11. 2022Perception Prioritized Training of Diffusion Modelscited by 301
  12. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  13. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  14. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  15. 2023On the Importance of Noise Scheduling for Diffusion Modelscited by 193
  16. 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
  17. 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
  18. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  19. 2022EpiGRAF: Rethinking training of 3D GANscited by 108
  20. 2020Learning Deformable Tetrahedral Meshes for 3D Reconstructioncited by 84
  21. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  22. 20213DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variationscited by 58
  23. 2019Learning a Neural 3D Texture Space from 2D Exemplarscited by 53
  24. 2020Convolutional Generation of Textured 3D Meshescited by 52
  25. 2020Implicit Mesh Reconstruction from Unannotated Image Collectionscited by 49
  26. 2021Cycle-Consistent Inverse GAN for Text-to-Image Synthesiscited by 27
  27. 2022ISS: Image as Stepping Stone for Text-Guided 3D Shape Generationcited by 27
  28. 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
  29. 2021Semi-supervised Synthesis of High-Resolution Editable Textures for 3D Humanscited by 21
  30. 2020GramGAN: Deep 3D Texture Synthesis From 2D Exemplarscited by 18
  31. 2018Im2Avatar: Colorful 3D Reconstruction from a Single Imagecited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 29; 2025: 17; 2026: 10.

63 papers.

Sort:

By area:

  1. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  2. 2024SemCity: Semantic Scene Generation with Triplane Diffusioncited by 53
  3. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  4. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 51
  5. 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
  6. 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
  7. 2024TexPainter: Generative Mesh Texturing with Multi-view Consistencycited by 29
  8. 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
  9. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  10. 2024Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusioncited by 27
  11. 2024MaPa: Text-driven Photorealistic Material Painting for 3D Shapescited by 27
  12. 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resamplingcited by 24
38 more
  1. 2025UniTEX: Universal High Fidelity Generative Texturing for 3D Shapescited by 23
  2. 2024InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpaintingcited by 22
  3. 2023Enhancing High-Resolution 3D Generation through Pixel-wise Gradient Clippingcited by 17
  4. 2024MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignmentcited by 14
  5. 2024RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpaintingcited by 14
  6. 2024WordRobe: Text-Guided Generation of Textured 3D Garmentscited by 13
  7. 2023Single Mesh Diffusion Models with Field Latents for Texture Generationcited by 11
  8. 2024Diffusion Models in 3D Vision: A Surveycited by 11
  9. 2024Make-A-Texture: Fast Shape-Aware Texture Generation in 3 Secondscited by 11
  10. 2024TexRO: Generating Delicate Textures of 3D Models by Recursive Optimizationcited by 9
  11. 2024SuperMat: Physically Consistent PBR Material Estimation at Interactive Ratescited by 9
  12. 2023Advances in 3D Neural Stylization: A Surveycited by 8
  13. 2024VCD-Texture: Variance Alignment based 3D-2D Co-Denoising for Text-Guided Texturingcited by 8
  14. 2024FlexiTex: Enhancing Texture Generation via Visual Guidancecited by 8
  15. 2024Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Textcited by 7
  16. 2025FlexPainter: Flexible and Multi-View Consistent Texture Generationcited by 7
  17. 2025SeqTex: Generate Mesh Textures in Video Sequencecited by 7
  18. 2025GAP: Gaussianize Any Point Clouds with Text Guidancecited by 7
  19. 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
  20. 2023ChromaDistill: Colorizing Monochrome Radiance Fields with Knowledge Distillationcited by 5
  21. 2024TexPro: Text-guided PBR Texturing with Procedural Material Modelingcited by 4
  22. 2025PBR-SR: Mesh PBR Texture Super Resolution from 2D Image Priorscited by 4
  23. 2025LaFiTe: A Generative Latent Field for 3D Native Texturingcited by 4
  24. 2023Directional Texture Editing for 3D Modelscited by 3
  25. 2023Consistent Mesh Diffusioncited by 3
  26. 2024Meta 3D Gencited by 3
  27. 2024UV-free Texture Generation with Denoising and Geodesic Heat Diffusionscited by 3
  28. 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generationcited by 3
  29. 2024RoCoTex: A Robust Method for Consistent Texture Synthesis with Diffusion Modelscited by 2
  30. 2024Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Modelscited by 2
  31. 2025MD-ProjTex: Texturing 3D Shapes with Multi-Diffusion Projectioncited by 2
  32. 2025PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Modelscited by 2
  33. 2025Large Material Gaussian Model for Relightable 3D Generationcited by 2
  34. 2025LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination Contextcited by 2
  35. 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
  36. 2024Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objectscited by 1
  37. 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshescited by 1
  38. 2025Consistent Zero-shot 3D Texture Synthesis Using Geometry-aware Diffusion and Temporal Video Modelscited by 1

50 most cited of 63 All 63 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation
  2. 2024PointDreamer: Zero-shot 3D Textured Mesh Reconstruction from Colored Point Cloud
  3. 2023EucliDreamer: Fast and High-Quality Texturing for 3D Models with Stable Diffusion Depth
  4. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation
  5. 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion
  6. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle
  7. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models
  8. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion