mlsanityData to 7 Oct 2026

FlashTex: Fast Relightable Mesh Texturing with LightControlNet

arXiv 2402.13251 ↗First posted 20 Feb 2024cs.GR cs.CV cs.LGcited by 56

Not on the map. Why?

Abstract (arXiv)

Manually creating textures for 3D meshes is time-consuming, even for expert visual content creators. We propose a fast approach for automatically texturing an input 3D mesh based on a user-provided text prompt. Importantly, our approach disentangles lighting from surface material/reflectance in the resulting texture so that the mesh can be properly relit and rendered in any lighting environment. We introduce LightControlNet, a new text-to-image model based on the ControlNet architecture, which allows the specification of the desired lighting as a conditioning image to the model. Our text-to-texture pipeline then constructs the texture in two stages. The first stage produces a sparse set of visually consistent reference views of the mesh using LightControlNet. The second stage applies a texture optimization based on Score Distillation Sampling (SDS) that works with LightControlNet to increase the texture quality while disentangling surface material from lighting. Our algorithm is significantly faster than previous text-to-texture methods, while producing high-quality and relightable textures.

Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 20 Feb 2024.

Builds on

56 of 68 references.

References · 56

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  12. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
38 more
  1. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  3. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  5. 2018Demystifying MMD GANscited by 1,268
  6. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  7. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,061
  8. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  9. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  10. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  11. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  12. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  13. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  14. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  15. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
  16. 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
  17. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  18. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  19. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  20. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 303
  21. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  22. 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
  23. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
  24. 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
  25. 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
  26. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Priorcited by 157
  27. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  28. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3Dcited by 134
  29. 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
  30. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 122
  31. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  32. 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
  33. 2021Learning Indoor Inverse Rendering with 3D Spatially-Varying Lightingcited by 82
  34. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generationcited by 81
  35. 2020Leveraging 2D Data to Learn Textured 3D Mesh Generationcited by 69
  36. 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
  37. 2018Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Imagecited by 66
  38. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 19; 2025: 28; 2026: 9.

56 papers.

Sort:

By area:

  1. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 111
  2. 2025DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Modelscited by 55
  3. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  4. 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 40
  5. 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relightingcited by 37
  6. 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translationcited by 36
  7. 2024MVPaint: Synchronized Multi-View Diffusion for Painting Anything 3Dcited by 34
  8. 2024Material Anything: Generating Materials for Any 3D Object via Diffusioncited by 31
  9. 2024TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splattingcited by 28
  10. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  11. 2025Generating Multi-Image Synthetic Data for Text-to-Image Customizationcited by 25
  12. 2025Generating Physically Stable and Buildable Brick Structures from Textcited by 23
38 more
  1. 2025UniTEX: Universal High Fidelity Generative Texturing for 3D Shapescited by 23
  2. 2024ScribbleLight: Single Image Indoor Relighting with Scribblescited by 22
  3. 2024GenLit: Reformulating Single-Image Relighting as Video Generationcited by 20
  4. 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
  5. 2024Connecting Consistency Distillation to Score Distillation for Text-to-3D Generationcited by 18
  6. 2024MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignmentcited by 14
  7. 2025Cube: A Roblox View of 3D Intelligencecited by 14
  8. 2025Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenizationcited by 12
  9. 2024Edify 3D: Scalable High-Quality 3D Asset Generationcited by 10
  10. 2024SuperMat: Physically Consistent PBR Material Estimation at Interactive Ratescited by 9
  11. 2024Birth and Death of a Rosecited by 7
  12. 2025FlexPainter: Flexible and Multi-View Consistent Texture Generationcited by 7
  13. 2025SViM3D: Stable Video Material Diffusion for Single Image 3D Generationcited by 7
  14. 2024Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generationcited by 6
  15. 2025IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generationcited by 6
  16. 2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyondcited by 5
  17. 2024Jointly Generating Multi-view Consistent PBR Textures using Collaborative Controlcited by 4
  18. 2024Meta 3D Gencited by 3
  19. 2025Hi3DEval: Advancing 3D Generation Evaluation with Hierarchical Validitycited by 3
  20. 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generationcited by 3
  21. 2026VideoMatGen: PBR Materials through Joint Generative Modelingcited by 3
  22. 2025MatCLIP: Light- and Shape-Insensitive Assignment of PBR Material Modelscited by 2
  23. 2025PacTure: Efficient PBR Texture Generation on Packed Views with Visual Autoregressive Modelscited by 2
  24. 2025Refracting Reality: Generating Images with Realistic Transparent Objectscited by 2
  25. 2025DoubleDiffusion: Combining Heat Diffusion with Denoising Diffusion for Texture Generation on 3D Meshescited by 1
  26. 2025PBR3DGen: A VLM-guided Mesh Generation with High-quality PBR Texturecited by 1
  27. 2025CasTex: Cascaded Text-to-Texture Synthesis via Explicit Texture Maps and Physically-Based Shadingcited by 1
  28. 2025ReLumix: Extending Image Relighting to Video via Video Diffusion Modelscited by 1
  29. 2025NI-Tex: Non-isometric Image-based Garment Texture Generationcited by 1
  30. 2025GOATex: Geometry & Occlusion-Aware Texturingcited by 1
  31. 2025MatLat: Material Latent Space for PBR Texture Generationcited by 1
  32. 2026LGTM: Training-Free Light-Guided Text-to-Image Diffusion Model via Initial Noise Manipulationcited by 1
  33. 2024An Optimization Framework to Enforce Multi-View Consistency for Texturing 3D Meshescited by 0
  34. 2025CaPa: Carve-n-Paint Synthesis for Efficient 4K Textured Mesh Generationcited by 0
  35. 2025HoloGarment: 360deg Novel View Synthesis of In-the-Wild Garmentscited by 0
  36. 2025FROMAT: Multiview Material Appearance Transfer via Few-Shot Self-Attention Adaptationcited by 0
  37. 2025An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenescited by 0
  38. 2026SyncLight: Single-Edit Multi-View Relightingcited by 0

50 most cited of 56 All 56 (JSON)