CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization
Not on the map. Why?
Abstract (arXiv)
The creation of high-fidelity, customizable 3D indoor scene textures remains a significant challenge. While text-driven methods offer flexibility, they lack the precision for fine-grained, instance-level control, and often produce textures with insufficient quality, artifacts, and baked-in shading. To overcome these limitations, we introduce CustomTex, a novel framework for instance-level, high-fidelity scene texturing driven by reference images. CustomTex takes an untextured 3D scene and a set of reference images specifying the desired appearance for each object instance, and generates a unified, high-resolution texture map. The core of our method is a dual-distillation approach that separates semantic control from pixel-level enhancement. We employ semantic-level distillation, equipped with an instance cross-attention, to ensure semantic plausibility and ``reference-instance'' alignment, and pixel-level distillation to enforce high visual fidelity. Both are unified within a Variational Score Distillation (VSD) optimization framework. Experiments demonstrate that CustomTex achieves precise instance-level consistency with reference images and produces textures with superior sharpness, reduced artifacts, and minimal baked-in shading compared to state-of-the-art methods. Our work establishes a more direct and user-friendly path to high-quality, customizable 3D scene appearance editing.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 66 of its 81 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
66 of 81 references.
References · 66
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
38 more
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
- 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
- 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 215
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
- 2021UniT: Multimodal Multitask Learning with a Unified Transformercited by 195
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
- 2019SDM-NET: Deep Generative Network for Structured Deformable Meshcited by 113
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 93
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2022UniT3D: A Unified Transformer for 3D Dense Captioning and Visual Groundingcited by 69
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2017Improved Adversarial Systems for 3D Object Generation and Reconstructioncited by 66
- 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
- 2018Learning Descriptor Networks for 3D Shape Synthesis and Analysiscited by 56
- 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
- 2020Convolutional Generation of Textured 3D Meshescited by 52
- 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52
- 2020Deep Geometric Texture Synthesiscited by 51
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.