mlsanityData to 14 Oct 2026

SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination

arXiv 2609.10363 ↗First posted 9 Sep 2026cs.CV cs.GRcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

SceneHI is a framework that lifts high-resolution, illumination-aware priors from 2D diffusion models to perform 3D texture synthesis. It is the first to demonstrate that high-resolution textures, previously limited to 2D synthesis, can be generated directly on 3D objects without model fine-tuning or optimization. Designed for complex, multi-object environments, SceneHI uniquely combines 3D-consistency, high-resolution fidelity, and physically plausible baked shadows within a single generative pipeline. To enforce strict geometric coherence, we introduce an exact analytical pixel-to-texel mapping that aligns diffusion trajectories across multiple viewpoints. We utilize High-Resolution Latent Textures (HRLTs) as a persistent canvas for gradually denoised textures, while camera views perform the denoising steps in latent pixel space. This ensures a shared base texture that can be subsequently refined to high resolution without compromising multi-view consistency. Finally, a light-aware generative pass embeds realistic geometry-consistent shadows directly into the atlases, bridging the gap to production workflows. SceneHI achieves high visual fidelity while reducing generation time by 80% compared to existing scene-level methods.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 56 of its 60 references that are in the map. First posted on arXiv 9 Sep 2026.

Builds on

56 of 60 references.

Closest ancestors · 18

Same direction, newest first

  1. 2024RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturing21 Dec
  2. 2024LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relighting29 Nov
  3. 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling2 Aug
  4. 2024RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting4 Jun
  5. 2024TexPainter: Generative Mesh Texturing with Multi-view Consistency17 May
  6. 2024GenesisTex: Adapting Image Denoising Diffusion to Texture Space26 Mar
  7. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Models21 Dec
  8. 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors28 Nov
  9. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct
  10. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  11. 2023Texture Generation on 3D Meshes with Point-UV Diffusion21 Aug
  12. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
6 more
  1. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  2. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  4. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  5. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  6. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 38

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2020Denoising Diffusion Implicit Modelscited by 9,781
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  9. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  12. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
26 more
  1. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  2. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  3. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  4. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  5. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  6. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  7. 2023Text-to-3D using Gaussian Splattingcited by 299
  8. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 142
  9. 2023ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Modelscited by 128
  10. 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 107
  11. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  12. 2017Improved Adversarial Systems for 3D Object Generation and Reconstructioncited by 66
  13. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 52
  14. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  15. 2024GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Renderingcited by 42
  16. 2025UniRelight: Learning Joint Decomposition and Synthesis for Video Relightingcited by 40
  17. 2024Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Imagecited by 32
  18. 2025How I Warped Your Noise: a Temporally-Correlated Noise Prior for Diffusion Modelscited by 32
  19. 2023DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagationcited by 25
  20. 2025Consistent Flow Distillation for Text-to-3D Generationcited by 17
  21. 2024Is One GPU Enough? Pushing Image Generation at Higher-Resolutions with Foundation Modelscited by 14
  22. 2025MV-CoLight: Efficient Object Compositing with Consistent Lighting and Shadow Generationcited by 8
  23. 2025MVPainter: Accurate and Detailed 3D Texture Generation via Multi-View Diffusion with Geometric Controlcited by 7
  24. 2023Differentiable Shadow Mapping for Efficient Inverse Graphicscited by 4
  25. 2026SSD-GS: Scattering and Shadow Decomposition for Relightable 3D Gaussian Splattingcited by 4
  26. 2026Radiometrically Consistent Gaussian Surfels for Inverse Renderingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior
  2. 2026UltraTex: Unleashing 2K Multi-View Diffusion for 3D Texturing
  3. 2026DirectUV: Image-Conditioned UV Texture Generation with Surface-Aware Positional Encoding
  4. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assets
  5. 2026FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors
  6. 2026Any 3D Scene is Worth 1K Tokens: 3D-Grounded Representation for Scene Generation at Scale
  7. 2025NaTex: Seamless Texture Generation as Latent Color Diffusion
  8. 2025ZeroScene: A Zero-Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editing