TEXTure: Text-Guided Texturing of 3D Shapes
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
In this paper, we present TEXTure, a novel method for text-guided generation, editing, and transfer of textures for 3D shapes. Leveraging a pretrained depth-to-image diffusion model, TEXTure applies an iterative scheme that paints a 3D model from different viewpoints. Yet, while depth-to-image models can create plausible textures from a single viewpoint, the stochastic nature of the generation process can cause many inconsistencies when texturing an entire 3D object. To tackle these problems, we dynamically define a trimap partitioning of the rendered image into three progression states, and present a novel elaborated diffusion sampling process that uses this trimap representation to generate seamless textures from different views. We then show that one can transfer the generated texture maps to new 3D geometries without requiring explicit surface-to-surface mapping, as well as extract semantic textures from a set of images without requiring any explicit reconstruction. Finally, we show that TEXTure can be used to not only generate new textures but also edit and refine existing textures using either a text prompt or user-provided scribbles. We demonstrate that our TEXTuring method excels at generating, transferring, and editing textures through extensive evaluation, and further close the gap between 2D image generation and 3D texturing.
Key facts. Cited by 303 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 29 of its 55 references that are in the map. First posted on arXiv 3 Feb 2023.
Builds on
29 of 55 references.
Closest ancestors · 3
Same direction, newest first
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 26
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
14 more
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2022Blended Latent Diffusioncited by 430
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 332
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2019Kaolin: A PyTorch Library for Accelerating 3D Deep Learning Researchcited by 98
- 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
- 2018Non-Stationary Texture Synthesis by Adversarial Expansioncited by 66
- 2020Deep Geometric Texture Synthesiscited by 51
- 2017TextureGAN: Controlling Deep Image Synthesis with Texture Patchescited by 47
- 2022Shape-Guided Diffusion with Inside-Outside Attentioncited by 45
- 2022ObjectStitch: Generative Object Compositingcited by 36
Built on by
Citing papers per year: 2023: 96; 2024: 104; 2025: 69; 2026: 34.
303 papers.
Sort:
By area:
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
38 more
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
- 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
- 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
- 2023Text-to-3D with Classifier Score Distillationcited by 127
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2025Hunyuan3D 2.5: Towards High-Fidelity 3D Assets Generation with Ultimate Detailscited by 120
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2023TADA! Text to Animatable Digital Avatarscited by 109
- 2023SyncDiffusion: Coherent Montage via Synchronized Joint Diffusionscited by 108
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
- 2023Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Taskcited by 91
- 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
- 2023HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generationcited by 88
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 85
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2023AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homescited by 81
- 2023SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstructioncited by 77
- 2023Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion Modelscited by 76
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
- 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
- 2023GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learningcited by 63
- 2023Gen2Sim: Scaling up Robot Learning in Simulation with Generative Modelscited by 62
- 2023The Chosen One: Consistent Characters in Text-to-Image Diffusion Modelscited by 62
- 2023Generative AI meets 3D: A Survey on Text-to-3D in AIGC Eracited by 61
- 2023AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Posecited by 60
- 2024FlashTex: Fast Relightable Mesh Texturing with LightControlNetcited by 56
- 2023Diffusion 3D Features (Diff3F): Decorating Untextured Shapes with Distilled Semantic Featurescited by 55
- 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
50 most cited of 303 All 303 (JSON)
- 2026DiDE:Direct Injection with Color-Texture DEcoupling for 3D Stylization1 Oct 2026
- 2026Texture Space Material Diffusion29 Sep 2026
- 2026TaoTex: Boosting Texture Detail Fidelity for Native 3D Material Generation28 Sep 2026
- 2026DirectUV: Image-Conditioned UV Texture Generation with Surface-Aware Positional Encoding28 Sep 2026
- 2026Does Native 3D Texture Generation Necessarily Require 3D Assets for Training?28 Sep 2026
- 2026OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction24 Sep 2026
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination9 Sep 2026
- 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylization30 Aug 2026
- 2026GLOSS: Geometric Local Self-Similarity Learning for Faithful Reference-Guided Texture Fill26 Aug 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026Texture++: Elevating 3D Asset Texture Resolution with a Region-Aware Diffusion Model23 Jul 2026
- 2026Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models1 Jul 2026
38 more
- 2026Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration1 Jul 2026
- 2026Accelerated Likelihood Maximization for Diffusion-based Versatile Content Generation30 Jun 2026
- 2026JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising18 Jun 2026
- 2026Variational Test-time Optimization for Diffusion Synchronization14 Jun 2026
- 2026PHAF-Personalized Hand Avatars in a Flash2 Jun 2026
- 2026Advances in Neural 3D Mesh Texturing: A Survey28 May 2026
- 2026AssetGen: Deployable 3D Asset Generation at Interactive Speed22 May 2026
- 2026DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformer15 May 2026
- 20263DReflecNet: A Large-Scale Dataset for 3D Reconstruction of Reflective, Transparent, and Low-Texture Objects11 May 2026
- 2026SeasonScapes: Learning Large-scale Re-lightable 3D Landscapes with Seasonal Variation from Sparse Webcams9 May 2026
- 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion6 May 2026
- 2026Hitem3D 2.0: Multi-View Guided Native 3D Texture Generation10 Apr 2026
- 2026GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidance7 Apr 2026
- 2026HandDreamer: Zero-Shot Text to 3D Hand Model Generation using Corrective Hand Shape Guidance6 Apr 2026
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2026VideoMatGen: PBR Materials through Joint Generative Modeling17 Mar 2026
- 2026MV2UV: Generating High-quality UV Texture Maps with Multiview Prompts16 Mar 2026
- 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model9 Mar 2026
- 2026GLASS: Graph and Vision-Language Assisted Semantic Shape Correspondence8 Mar 2026
- 2026TexSpot: 3D Texture Enhancement with Spatially-uniform Point Latent Representation12 Feb 2026
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Image4 Feb 2026
- 2026ScribbleSense: Generative Scribble-Based Texture Editing with Intent Prediction30 Jan 2026
- 2025MatLat: Material Latent Space for PBR Texture Generation19 Dec 2025
- 2025AnchorHOI: Zero-shot Generation of 4D Human-Object Interaction via Anchor-based Prior Distillation16 Dec 2025
- 2025An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenes15 Dec 2025
- 2025LaFiTe: A Generative Latent Field for 3D Native Texturing4 Dec 2025
- 2025GOATex: Geometry & Occlusion-Aware Texturing28 Nov 2025
- 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generation26 Nov 2025
- 2025LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination Context24 Nov 2025
- 2025MatMart: Material Reconstruction of 3D Objects via Diffusion24 Nov 2025
- 2025NI-Tex: Non-isometric Image-based Garment Texture Generation24 Nov 2025
- 2025NaTex: Seamless Texture Generation as Latent Color Diffusion20 Nov 2025
- 2025GuideFlow3D: Optimization-Guided Rectified Flow For Appearance Transfer17 Oct 2025
- 2025Coupled Diffusion Sampling for Training-Free Multi-View Image Editing16 Oct 2025
- 2025GaussEdit: Adaptive 3D Scene Editing with Text and Image Prompts30 Sep 2025
- 2025ASIA: Adaptive 3D Segmentation using Few Image Annotations29 Sep 2025
- 2025ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editing28 Sep 2025
- 2025VideoFrom3D: 3D Scene Video Generation via Complementary Image and Video Diffusion Models22 Sep 2025
50 newest of 303 All 303 (JSON)
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyondcited by 139
- 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
- 2023Text-to-3D with Classifier Score Distillationcited by 127
12 most cited of 121 All 121 (JSON)
- 2026DiDE:Direct Injection with Color-Texture DEcoupling for 3D Stylization1 Oct 2026
- 2026Texture Space Material Diffusion29 Sep 2026
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination9 Sep 2026
- 2026Texture++: Elevating 3D Asset Texture Resolution with a Region-Aware Diffusion Model23 Jul 2026
- 2026Accelerated Likelihood Maximization for Diffusion-based Versatile Content Generation30 Jun 2026
- 2026Variational Test-time Optimization for Diffusion Synchronization14 Jun 2026
- 2026DealMaTe: Multi-Dimensional Material Transfer via Diffusion Transformer15 May 2026
- 2026GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidance7 Apr 2026
- 2026VideoMatGen: PBR Materials through Joint Generative Modeling17 Mar 2026
- 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model9 Mar 2026
- 2026TexSpot: 3D Texture Enhancement with Spatially-uniform Point Latent Representation12 Feb 2026
- 2025AnchorHOI: Zero-shot Generation of 4D Human-Object Interaction via Anchor-based Prior Distillation16 Dec 2025
12 newest of 121 All 121 (JSON)
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
- 2023TADA! Text to Animatable Digital Avatarscited by 109
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2023DreamHuman: Animatable 3D Avatars from Textcited by 102
- 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
12 most cited of 177 All 177 (JSON)
- 2026TaoTex: Boosting Texture Detail Fidelity for Native 3D Material Generation28 Sep 2026
- 2026DirectUV: Image-Conditioned UV Texture Generation with Surface-Aware Positional Encoding28 Sep 2026
- 2026Does Native 3D Texture Generation Necessarily Require 3D Assets for Training?28 Sep 2026
- 2026OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction24 Sep 2026
- 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylization30 Aug 2026
- 2026GLOSS: Geometric Local Self-Similarity Learning for Faithful Reference-Guided Texture Fill26 Aug 2026
- 2026GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport13 Aug 2026
- 2026Ink3D: Sculpting 3D Assets with Extremely Complex Textures via Video Generative Models1 Jul 2026
- 2026Restore3D: Breathing Life into Broken Objects with Shape and Texture Restoration1 Jul 2026
- 2026JanusMesh: Fast and Zero-Shot 3D Visual Illusion Generation via Cross-Space Denoising18 Jun 2026
- 2026PHAF-Personalized Hand Avatars in a Flash2 Jun 2026
- 2026Advances in Neural 3D Mesh Texturing: A Survey28 May 2026
12 newest of 177 All 177 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Infinite Texture: Text-guided High Resolution Diffusion Texture Synthesis
- 2023Text-Guided 3D Face Synthesis -- From Generation to Editing
- 2024EucliDreamer: Fast and High-Quality Texturing for 3D Models with Depth-Conditioned Stable Diffusion
- 2024On Synthetic Texture Datasets: Challenges, Creation, and Curation
- 2025TriTex: Learning Texture from a Single Mesh via Triplane Semantic Features
- 2025Textured 3D Regenerative Morphing with 3D Diffusion Prior
- 2024ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
- 2025Shape from Semantics: 3D Shape Generation from Multi-View Semantics