mlsanityData to 7 Oct 2026

SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors

arXiv 2311.17261 ↗First posted 28 Nov 2023cs.CVcited by 43

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We propose SceneTex, a novel method for effectively generating high-quality and style-consistent textures for indoor scenes using depth-to-image diffusion priors. Unlike previous methods that either iteratively warp 2D views onto a mesh surface or distillate diffusion latent features without accurate geometric and style cues, SceneTex formulates the texture synthesis task as an optimization problem in the RGB space where style and geometry consistency are properly reflected. At its core, SceneTex proposes a multiresolution texture field to implicitly encode the mesh appearance. We optimize the target texture via a score-distillation-based objective function in respective RGB renderings. To further secure the style consistency across views, we introduce a cross-attention decoder to predict the RGB values by cross-attending to the pre-sampled reference locations in each instance. SceneTex enables various and accurate texture synthesis for 3D-FRONT scenes, demonstrating significant improvements in visual quality and prompt fidelity over the prior texture generation methods.

Key facts. Cited by 43 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 66 of its 75 references that are in the map. First posted on arXiv 28 Nov 2023.

Builds on

66 of 75 references.

Closest ancestors · 10

Same direction, newest first

  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  2. 2023LDM3D: Latent Diffusion Model for 3D18 May
  3. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  4. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
  5. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  6. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec
  7. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  8. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  9. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  10. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 56

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  8. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  9. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  10. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  11. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  12. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
38 more
  1. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  2. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  3. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  4. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  5. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  6. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  7. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
  8. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  9. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  10. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
  11. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  12. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  13. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
  14. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  15. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
  16. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  17. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  18. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  19. 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
  20. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  21. 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
  22. 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 215
  23. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  24. 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
  25. 2021UniT: Multimodal Multitask Learning with a Unified Transformercited by 195
  26. 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
  27. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  28. 2016Controlling Perceptual Factors in Neural Style Transfercited by 99
  29. 2022UniT3D: A Unified Transformer for 3D Dense Captioning and Visual Groundingcited by 69
  30. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  31. 2017Improved Adversarial Systems for 3D Object Generation and Reconstructioncited by 66
  32. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  33. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  34. 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
  35. 2018Learning Descriptor Networks for 3D Shape Synthesis and Analysiscited by 56
  36. 2021Sketch2Model: View-Aware 3D Modeling from Single Free-Hand Sketchescited by 54
  37. 2020Convolutional Generation of Textured 3D Meshescited by 52
  38. 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 21; 2025: 14; 2026: 7.

43 papers.

Sort:

By area:

  1. 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
  2. 2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
  3. 2025SceneWeaver: All-in-One 3D Scene Synthesis with an Extensible and Self-Reflective Agentcited by 53
  4. 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 41
  5. 2024Rethinking Score Distillation as a Bridge Between Image Distributionscited by 36
  6. 2024Mixed Diffusion for 3D Indoor Scene Synthesiscited by 30
  7. 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
  8. 2024A Comprehensive Survey on 3D Content Generationcited by 28
  9. 2025MaterialMVP: Illumination-Invariant Material Generation via Multi-view PBR Diffusioncited by 28
  10. 20253D Scene Generation: A Surveycited by 24
  11. 2024ArtFormer: Controllable Generation of Diverse 3D Articulated Objectscited by 21
  12. 2025NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenescited by 19
31 more
  1. 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videoscited by 18
  2. 2024AToM: Amortized Text-to-Mesh using 2D Diffusioncited by 18
  3. 2025IntrinsiX: High-Quality PBR Generation using Image Priorscited by 18
  4. 2024RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpaintingcited by 14
  5. 2024GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinementcited by 14
  6. 2025WorldGrow: Generating Infinite 3D Worldcited by 14
  7. 2024Text-to-3D Shape Generationcited by 13
  8. 2024Diffusion Models in 3D Vision: A Surveycited by 11
  9. 2024RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturingcited by 10
  10. 2024Planner3D: LLM-enhanced graph prior meets 3D indoor scene explicit regularizationcited by 9
  11. 2024MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenescited by 9
  12. 2024GenesisTex2: Stable, Consistent and High-Quality Text-to-Texture Generationcited by 8
  13. 2026World Reconstruction From Inconsistent Viewscited by 8
  14. 2024NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editingcited by 7
  15. 2025GAP: Gaussianize Any Point Clouds with Text Guidancecited by 7
  16. 2025MOSAIC: Generating Consistent, Privacy-Preserving Scenes from Multiple Depth Views in Multi-Room Environmentscited by 4
  17. 2023Virtual Pets: Animatable Animal Generation in 3D Scenescited by 3
  18. 2025MeSS: City Mesh-Guided Outdoor Scene Generation with Cross-View Consistent Diffusioncited by 3
  19. 2024Prim2Room: Layout-Controllable Room Mesh Generation from Primitivescited by 2
  20. 2024Tex4D: Zero-shot 4D Scene Texturing with Video Diffusion Modelscited by 2
  21. 2025LumiTex: Towards High-Fidelity PBR Texture Generation with Illumination Contextcited by 2
  22. 2024Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objectscited by 1
  23. 2025Hybrid Mesh-Gaussian Representation for Efficient Indoor Scene Reconstructioncited by 1
  24. 2025Generative Augmented Reality: Paradigms, Technologies, and Future Applicationscited by 1
  25. 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customizationcited by 1
  26. 2025An evaluation of SVBRDF Prediction from Generative Image Models for Appearance Modeling of 3D Scenescited by 0
  27. 2026Advances in Neural 3D Mesh Texturing: A Surveycited by 0
  28. 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignmentcited by 0
  29. 2026Interpretable Human-Label-Free Deep Learning for Real-Bogus Classification with Uncertainty Quantificationcited by 0
  30. 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylizationcited by 0
  31. 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illuminationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025InsTex: Indoor Scenes Stylized Texture Synthesis
  2. 2026UltraTex: Unleashing 2K Multi-View Diffusion for 3D Texturing
  3. 2024GenesisTex: Adapting Image Denoising Diffusion to Texture Space
  4. 2023TwinTex: Geometry-aware Texture Generation for Abstracted 3D Architectural Models
  5. 2024StyleTex: Style Image-Guided Texture Generation for 3D Models
  6. 2026TaoTex: Boosting Texture Detail Fidelity for Native 3D Material Generation
  7. 2025NaTex: Seamless Texture Generation as Latent Color Diffusion
  8. 2025RomanTex: Decoupling 3D-aware Rotary Positional Embedded Multi-Attention Network for Texture Synthesis