RoomPainter: View-Integrated Diffusion for Consistent Indoor Scene Texturing
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Indoor scene texture synthesis has garnered significant interest due to its important potential applications in virtual reality, digital media and creative arts. Existing diffusion-model-based researches either rely on per-view inpainting techniques, which are plagued by severe cross-view inconsistencies and conspicuous seams, or adopt optimization-based approaches that involve substantial computational overhead. In this work, we present RoomPainter, a framework that seamlessly integrates efficiency and consistency to achieve high-fidelity texturing of indoor scenes. The core of RoomPainter features a zero-shot technique that effectively adapts a 2D diffusion model for 3D-consistent texture synthesis, along with a two-stage generation strategy that ensures both global and local consistency. Specifically, we introduce Attention-Guided Multi-View Integrated Sampling (MVIS) combined with a neighbor-integrated attention mechanism for zero-shot texture map generation. Using the MVIS, we firstly generate texture map for the entire room to ensure global consistency, then adopt its variant, namely Attention-Guided Multi-View Integrated Repaint Sampling (MVRS) to repaint individual instances within the room, thereby further enhancing local consistency and addressing the occlusion problem. Experiments demonstrate that RoomPainter achieves superior performance for indoor scene texture synthesis in visual quality, global consistency and generation efficiency.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 51 of its 57 references that are in the map. First posted on arXiv 21 Dec 2024.
Builds on
51 of 57 references.
Closest ancestors · 19
Same direction, newest first
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024TexGen: Text-Guided 3D Texture Generation with Multi-view Sampling and Resampling2 Aug
- 2024HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions21 Jul
- 2024RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting4 Jun
- 2024GenesisTex: Adapting Image Denoising Diffusion to Texture Space26 Mar
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors28 Nov
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct
- 2023HiFi-123: Towards High-fidelity One Image to 3D Content Generation10 Oct
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields19 May
7 more
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 2023TEXTure: Text-Guided Texturing of 3D Shapes3 Feb
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
Other references · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
20 more
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 375
- 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 228
- 2023Style Aligned Image Generation via Shared Attentioncited by 214
- 2023MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusioncited by 210
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
- 2023Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenescited by 75
- 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
- 2023NOFA: NeRF-based One-shot Facial Avatar Reconstructioncited by 53
- 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
- 2023Text2Immersion: Generative Immersive Scene with 3D Gaussianscited by 43
- 2023DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagationcited by 25
- 2024InTeX: Interactive Text-to-texture Synthesis via Unified Depth-aware Inpaintingcited by 22
Built on by
Citing papers per year: 2025: 4; 2026: 6.
10 papers.
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 20253D Scene Generation: A Surveycited by 24
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Meshcited by 2
- 2026UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Modelscited by 2
- 2025SceneLCM: End-to-End Layout-Guided Interactive Indoor Scene Generation with Latent Consistency Modelcited by 1
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customizationcited by 1
- 2025SwapAnyone: Consistent and Realistic Video Synthesis for Swapping Any Person into Any Videocited by 0
- 2026Advances in Neural 3D Mesh Texturing: A Surveycited by 0
- 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignmentcited by 0
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illuminationcited by 0
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination9 Sep 2026
- 2026UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models5 Aug 2026
- 2026Video Models as Native 4D Renderers: World-Grounded Conditioning from Animated Mesh30 Jul 2026
- 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment5 Jun 2026
- 2026Advances in Neural 3D Mesh Texturing: A Survey28 May 2026
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2025SceneLCM: End-to-End Layout-Guided Interactive Indoor Scene Generation with Latent Consistency Model8 Jun 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2025SwapAnyone: Consistent and Realistic Video Synthesis for Swapping Any Person into Any Video12 Mar 2025
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models7 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2023RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistency
- 2025InsTex: Indoor Scenes Stylized Texture Synthesis
- 2025MVRoom: Controllable 3D Indoor Scene Generation with Multi-View Diffusion Models
- 2025CaPa: Carve-n-Paint Synthesis for Efficient 4K Textured Mesh Generation
- 2023DiffuScene: Denoising Diffusion Models for Generative Indoor Scene Synthesis
- 2024Mixed Diffusion for 3D Indoor Scene Synthesis
- 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation