mlsanityData to 7 Oct 2026

TexPainter: Generative Mesh Texturing with Multi-view Consistency

arXiv 2406.18539 ↗First posted 17 May 2024cs.CV cs.GRcited by 29

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

The recent success of pre-trained diffusion models unlocks the possibility of the automatic generation of textures for arbitrary 3D meshes in the wild. However, these models are trained in the screen space, while converting them to a multi-view consistent texture image poses a major obstacle to the output quality. In this paper, we propose a novel method to enforce multi-view consistency. Our method is based on the observation that latent space in a pre-trained diffusion model is noised separately for each camera view, making it difficult to achieve multi-view consistency by directly manipulating the latent codes. Based on the celebrated Denoising Diffusion Implicit Models (DDIM) scheme, we propose to use an optimization-based color-fusion to enforce consistency and indirectly modify the latent codes by gradient back-propagation. Our method further relaxes the sequential dependency assumption among the camera views. By evaluating on a series of general 3D models, we find our simple approach improves consistency and overall quality of the generated textures as compared to competing state-of-the-arts. Our implementation is available at: https://github.com/Quantuman134/TexPainter

Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 27 of its 52 references that are in the map. First posted on arXiv 17 May 2024.

Builds on

27 of 52 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023Boosting3D: High-Fidelity Image-to-3D by Boosting 2D Diffusion Prior to 3D Prior with Progressive Learning22 Nov
  2. 2023Texture Generation on 3D Meshes with Point-UV Diffusion21 Aug
  3. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  4. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  5. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
  6. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  7. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  8. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 19

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2022Classifier-Free Diffusion Guidancecited by 5,717
  4. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  5. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  6. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  7. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  8. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  9. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  10. 2022Blended Latent Diffusioncited by 430
  11. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
  12. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
7 more
  1. 2016EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesiscited by 177
  2. 2016Generative and Discriminative Voxel Modeling with Convolutional Neural Networkscited by 128
  3. 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
  4. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  5. 2022AUV-Net: Learning Aligned UV Maps for Texture Transfer and Synthesiscited by 39
  6. 2023Mesh2Tex: Generating Mesh Textures from Image Queriescited by 31
  7. 2023ShaDDR: Interactive Example-Based Geometry and Texture Generation via 3D Shape Detailization and Differentiable Renderingcited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 16; 2026: 7.

29 papers.

Sort:

By area:

  1. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  2. 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
  3. 2024MVPaint: Synchronized Multi-View Diffusion for Painting Anything 3Dcited by 34
  4. 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
  5. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  6. 2025UniTEX: Universal High Fidelity Generative Texturing for 3D Shapescited by 23
  7. 2025RomanTex: Decoupling 3D-aware Rotary Positional Embedded Multi-Attention Network for Texture Synthesiscited by 20
  8. 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
  9. 2025Pandora3D: A Comprehensive Framework for High-Quality 3D Shape and Texture Generationcited by 14
  10. 2024Diffusion Models in 3D Vision: A Surveycited by 11
  11. 2024FlexiTex: Enhancing Texture Generation via Visual Guidancecited by 8
  12. 2025StochSync: Stochastic Diffusion Synchronization for Image Generation in Arbitrary Spacescited by 8
17 more
  1. 2025MuMA: 3D PBR Texturing via Multi-Channel Multi-View Generation and Agentic Post-Processingcited by 8
  2. 2025VideoFrom3D: 3D Scene Video Generation via Complementary Image and Video Diffusion Modelscited by 8
  3. 2025FlexPainter: Flexible and Multi-View Consistent Texture Generationcited by 7
  4. 2024Jointly Generating Multi-view Consistent PBR Textures using Collaborative Controlcited by 4
  5. 2025Im2SurfTex: Surface Texture Generation via Neural Backprojection of Multi-View Imagescited by 3
  6. 2025SRHand: Super-Resolving Hand Images and 3D Shapes via View/Pose-aware Neural Image Representations and Explicit 3D Meshescited by 3
  7. 2025MD-ProjTex: Texturing 3D Shapes with Multi-Diffusion Projectioncited by 2
  8. 2025PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Modelscited by 2
  9. 2025A Scalable Attention-Based Approach for Image-to-3D Texture Mappingcited by 1
  10. 2025An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenescited by 0
  11. 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Modelcited by 0
  12. 2026MV2UV: Generating High-quality UV Texture Maps with Multiview Promptscited by 0
  13. 2026Advances in Neural 3D Mesh Texturing: A Surveycited by 0
  14. 2026Variational Test-time Optimization for Diffusion Synchronizationcited by 0
  15. 2026Accelerated Likelihood Maximization for Diffusion-based Versatile Content Generationcited by 0
  16. 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylizationcited by 0
  17. 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illuminationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models
  2. 2024An Optimization Framework to Enforce Multi-View Consistency for Texturing 3D Meshes
  3. 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling
  4. 2024Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Models
  5. 2024TEXGen: a Generative Diffusion Model for Mesh Textures
  6. 2023Text-Guided Texturing by Synchronized Multi-View Diffusion
  7. 2026TexSpot: 3D Texture Enhancement with Spatially-uniform Point Latent Representation
  8. 2023Consistent Mesh Diffusion