mlsanityData to 7 Oct 2026

Texturify: Generating Textures on 3D Shape Surfaces

arXiv 2204.02411 ↗First posted 5 Apr 2022cs.CV cs.GRcited by 65

Not on the map. Why?

Cited by 24 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Texture cues on 3D objects are key to compelling visual representations, with the possibility to create high visual fidelity with inherent spatial consistency across different views. Since the availability of textured 3D shapes remains very limited, learning a 3D-supervised data-driven method that predicts a texture based on the 3D input is very challenging. We thus propose Texturify, a GAN-based method that leverages a 3D shape dataset of an object class and learns to reproduce the distribution of appearances observed in real images by generating high-quality textures. In particular, our method does not require any 3D color supervision or correspondence between shape geometry and images to learn the texturing of 3D objects. Texturify operates directly on the surface of the 3D objects by introducing face convolutional operators on a hierarchical 4-RoSy parametrization to generate plausible object-specific textures. Employing differentiable rendering and adversarial losses that critique individual views and consistency across views, we effectively learn the high-quality surface texturing distribution from real-world images. Experiments on car and chair shape collections show that our approach outperforms state of the art by an average of 22% in FID score.

Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Builds on 45 of its 54 references that are in the map. First posted on arXiv 5 Apr 2022.

Builds on

45 of 54 references.

References · 45

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  8. 2018Demystifying MMD GANscited by 1,268
  9. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  10. 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
  11. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  12. 2020Convolutional Occupancy Networkscited by 760
33 more
  1. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  2. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  3. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  4. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  5. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  6. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 465
  7. 2019PointRend: Image Segmentation as Renderingcited by 439
  8. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  9. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  10. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  11. 2021Neural RGB-D Surface Reconstructioncited by 312
  12. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
  13. 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
  14. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  15. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  16. 2018Tangent Convolutions for Dense Prediction in 3Dcited by 173
  17. 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
  18. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  19. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  20. 2015A Large-Scale Car Dataset for Fine-Grained Categorization and Verificationcited by 129
  21. 2018Visual Object Networks: Image Generation with Disentangled 3D Representationcited by 124
  22. 20163D Shape Induction from 2D Views of Multiple Objectscited by 121
  23. 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
  24. 2019SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scanscited by 77
  25. 2021A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesiscited by 72
  26. 2020GIQA: Generated Image Quality Assessmentcited by 51
  27. 2018TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshescited by 45
  28. 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
  29. 2020SPSG: Self-Supervised Photometric Scene Generation from RGB-D Scanscited by 34
  30. 2020Implicit Feature Networks for Texture Completion from Partial 3D Datacited by 31
  31. 2020Adversarial Texture Optimization from RGB-D Scanscited by 30
  32. 2021RetrievalFuse: Neural 3D Scene Reconstruction with a Databasecited by 28
  33. 2018Im2Avatar: Colorful 3D Reconstruction from a Single Imagecited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 22; 2024: 24; 2025: 12; 2026: 5.

65 papers.

Sort:

By area:

  1. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  2. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  3. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  4. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  5. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  6. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  7. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  8. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  9. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  10. 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
  11. 2024Learning the 3D Fauna of the Webcited by 58
  12. 2024FlashTex: Fast Relightable Mesh Texturing with LightControlNetcited by 56
38 more
  1. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  2. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 51
  3. 2023Large-Vocabulary 3D Diffusion Model with Transformercited by 48
  4. 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
  5. 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
  6. 2023X-Mesh: Towards Fast and Accurate Text-driven 3D Stylization via Dynamic Textual Guidancecited by 37
  7. 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
  8. 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 34
  9. 2023Mesh2Tex: Generating Mesh Textures from Image Queriescited by 31
  10. 2024TexPainter: Generative Mesh Texturing with Multi-view Consistencycited by 29
  11. 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
  12. 2023SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearancecited by 24
  13. 2025UniTEX: Universal High Fidelity Generative Texturing for 3D Shapescited by 23
  14. 2024InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpaintingcited by 22
  15. 2023Breathing New Life into 3D Assets with Generative Repaintingcited by 17
  16. 2024GenesisTex: Adapting Image Denoising Diffusion to Texture Spacecited by 15
  17. 2024MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignmentcited by 14
  18. 2024RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpaintingcited by 14
  19. 2024StyleTex: Style Image-Guided Texture Generation for 3D Modelscited by 14
  20. 2023ShaDDR: Interactive Example-Based Geometry and Texture Generation via 3D Shape Detailization and Differentiable Renderingcited by 13
  21. 2023Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AIcited by 11
  22. 2023Single Mesh Diffusion Models with Field Latents for Texture Generationcited by 11
  23. 2023Mesh Neural Cellular Automatacited by 10
  24. 2023TUVF: Learning Generalizable Texture UV Radiance Fieldscited by 9
  25. 2024TexRO: Generating Delicate Textures of 3D Models by Recursive Optimizationcited by 9
  26. 2024DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generationcited by 9
  27. 2024FlexiTex: Enhancing Texture Generation via Visual Guidancecited by 8
  28. 2023Cloth2Tex: A Customized Cloth Texture Generation Pipeline for 3D Virtual Try-Oncited by 7
  29. 2025FlexPainter: Flexible and Multi-View Consistent Texture Generationcited by 7
  30. 2025SeqTex: Generate Mesh Textures in Video Sequencecited by 7
  31. 2025NaTex: Seamless Texture Generation as Latent Color Diffusioncited by 7
  32. 2024Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generationcited by 6
  33. 2024Part-aware Shape Generation with Latent 3D Diffusion of Neural Voxel Fieldscited by 5
  34. 2024FruitNinja: 3D Object Interior Texture Generation with Gaussian Splattingcited by 5
  35. 2023Scene-Conditional 3D Object Stylization and Compositioncited by 4
  36. 2025PBR-SR: Mesh PBR Texture Super Resolution from 2D Image Priorscited by 4
  37. 2025LaFiTe: A Generative Latent Field for 3D Native Texturingcited by 4
  38. 2024Meta 3D Gencited by 3

50 most cited of 65 All 65 (JSON)