UV-free Texture Generation with Denoising and Geodesic Heat Diffusions
Not on the map. Why?
Abstract (arXiv)
Seams, distortions, wasted UV space, vertex-duplication, and varying resolution over the surface are the most prominent issues of the standard UV-based texturing of meshes. These issues are particularly acute when automatic UV-unwrapping techniques are used. For this reason, instead of generating textures in automatically generated UV-planes like most state-of-the-art methods, we propose to represent textures as coloured point-clouds whose colours are generated by a denoising diffusion probabilistic model constrained to operate on the surface of 3D objects. Our sampling and resolution agnostic generative model heavily relies on heat diffusion over the surface of the meshes for spatial communication between points. To enable processing of arbitrarily sampled point-cloud textures and ensure long-distance texture consistency we introduce a fast re-sampling of the mesh spectral properties used during the heat diffusion and introduce a novel heat-diffusion-based self-attention mechanism. Our code and pre-trained models are available at github.com/simofoti/UV3-TeD.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 66 references that are in the map. First posted on arXiv 29 Aug 2024.
Builds on
36 of 66 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2018Group Normalizationcited by 1,514
- 2018Demystifying MMD GANscited by 1,268
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2019Quantifying the Carbon Emissions of Machine Learningcited by 516
24 more
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 163
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
- 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
- 2023On the Design Fundamentals of Diffusion Models: A Surveycited by 59
- 20213DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variationscited by 58
- 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesiscited by 39
- 2020SPSG: Self-Supervised Photometric Scene Generation from RGB-D Scanscited by 34
- 2023Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shapecited by 29
- 2023TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervisioncited by 28
- 2023Pointersect: Neural Rendering with Cloud-Ray Intersectioncited by 23
- 2021Rendering Point Clouds with Compute Shaders and Vertex Order Optimizationcited by 14
- 2023Manifold Diffusion Fieldscited by 11
- 2023Single Mesh Diffusion Models with Field Latents for Texture Generationcited by 11
- 2023TUVF: Learning Generalizable Texture UV Radiance Fieldscited by 9
Built on by
Citing papers per year: 2025: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026DirectUV: Image-Conditioned UV Texture Generation with Surface-Aware Positional Encoding
- 2024TEXGen: a Generative Diffusion Model for Mesh Textures
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusion
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion
- 2024PointDreamer: Zero-shot 3D Textured Mesh Reconstruction from Colored Point Cloud
- 2023Consistent Mesh Diffusion
- 2023EucliDreamer: Fast and High-Quality Texturing for 3D Models with Stable Diffusion Depth
- 2025MeshGen: Generating PBR Textured Mesh with Render-Enhanced Auto-Encoder and Generative Data Augmentation