mlsanityData to 7 Oct 2026

RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturing

arXiv 2412.16778 ↗First posted 21 Dec 2024cs.CVcited by 10

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Indoor scene texture synthesis has garnered significant interest due to its important potential applications in virtual reality, digital media and creative arts. Existing diffusion-model-based researches either rely on per-view inpainting techniques, which are plagued by severe cross-view inconsistencies and conspicuous seams, or adopt optimization-based approaches that involve substantial computational overhead. In this work, we present RoomPainter, a framework that seamlessly integrates efficiency and consistency to achieve high-fidelity texturing of indoor scenes. The core of RoomPainter features a zero-shot technique that effectively adapts a 2D diffusion model for 3D-consistent texture synthesis, along with a two-stage generation strategy that ensures both global and local consistency. Specifically, we introduce Attention-Guided Multi-View Integrated Sampling (MVIS) combined with a neighbor-integrated attention mechanism for zero-shot texture map generation. Using the MVIS, we firstly generate texture map for the entire room to ensure global consistency, then adopt its variant, namely Attention-Guided Multi-View Integrated Repaint Sampling (MVRS) to repaint individual instances within the room, thereby further enhancing local consistency and addressing the occlusion problem. Experiments demonstrate that RoomPainter achieves superior performance for indoor scene texture synthesis in visual quality, global consistency and generation efficiency.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 51 of its 57 references that are in the map. First posted on arXiv 21 Dec 2024.

Builds on

51 of 57 references.

Closest ancestors · 19

Same direction, newest first

  1. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
  2. 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling2 Aug
  3. 2024HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions21 Jul
  4. 2024RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting4 Jun
  5. 2024GenesisTex: Adapting Image Denoising Diffusion to Texture Space26 Mar
  6. 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors28 Nov
  7. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  8. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct
  9. 2023HiFi-123: Towards High-fidelity One Image to 3D Content Generation10 Oct
  10. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  12. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields19 May
7 more
  1. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  2. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  4. 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
  5. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  6. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  7. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan

Other references · 32

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  9. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  12. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
20 more
  1. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  2. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  3. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  4. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  5. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  6. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
  7. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  8. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
  9. 2023Style Aligned Image Generation via Shared Attentioncited by 214
  10. 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
  11. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  12. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  13. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  14. 2023Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenescited by 75
  15. 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
  16. 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
  17. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  18. 2023Text2Immersion: Generative Immersive Scene with 3D Gaussianscited by 43
  19. 2023DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagationcited by 25
  20. 2024InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpaintingcited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 6.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture
  2. 2024TexPainter: Generative Mesh Texturing with Multi-view Consistency
  3. 2025InsTex: Indoor Scenes Stylized Texture Synthesis
  4. 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Models
  5. 2025CaPa: Carve-n-Paint Synthesis for Efficient 4K Textured Mesh Generation
  6. 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis
  7. 2024Mixed Diffusion for 3D Indoor Scene Synthesis
  8. 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation