mlsanityData to 13 Oct 2026

Virtual Home Staging: Inverse Rendering and Editing an Indoor Panorama under Natural Illumination

arXiv 2311.12265 ↗First posted 21 Nov 2023cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

We propose a novel inverse rendering method that enables the transformation of existing indoor panoramas with new indoor furniture layouts under natural illumination. To achieve this, we captured indoor HDR panoramas along with real-time outdoor hemispherical HDR photographs. Indoor and outdoor HDR images were linearly calibrated with measured absolute luminance values for accurate scene relighting. Our method consists of three key components: (1) panoramic furniture detection and removal, (2) automatic floor layout design, and (3) global rendering with scene geometry, new furniture objects, and a real-time outdoor photograph. We demonstrate the effectiveness of our workflow in rendering indoor scenes under different outdoor illumination conditions. Additionally, we contribute a new calibrated HDR (Cali-HDR) dataset that consists of 137 calibrated indoor panoramas and their associated outdoor photographs.

Key facts. Cited by 5 papers in the map (data through 13 Oct 2026). Builds on 31 of its 51 references that are in the map. First posted on arXiv 21 Nov 2023.

Builds on

31 of 51 references.

References · 31

  1. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,068
  2. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 733
  3. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 308
  4. 2019Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF from a Single Imagecited by 202
  5. 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 172
  6. 2017Learning to Predict Indoor Illumination from a Single Imagecited by 160
  7. 2020Single-Image HDR Reconstruction by Learning to Reverse the Camera Pipelinecited by 131
  8. 2018LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Imagecited by 94
  9. 2019Deep Parametric Indoor Lighting Estimationcited by 82
  10. 2016IM2CADcited by 78
  11. 2019Fast Spatially-Varying Indoor Lighting Estimationcited by 72
  12. 2019Rendering Synthetic Objects into Legacy Photographscited by 72
19 more
  1. 2018Holistic 3D Scene Parsing and Reconstruction from a Single RGB Imagecited by 69
  2. 2018DuLa-Net: A Dual-Projection Network for Estimating Room Layouts from a Single RGB Panoramacited by 67
  3. 2018Cube Padding for Weakly-Supervised Saliency Prediction in 360deg Videoscited by 66
  4. 2019DeepLight: Learning Illumination for Unconstrained Mobile Mixed Realitycited by 63
  5. 2020Lighthouse: Predicting Lighting Volumes for Spatially-Coherent Illuminationcited by 62
  6. 2022Physically-Based Editing of Indoor Scene Lighting from a Single Imagecited by 62
  7. 2019Orientation-aware Semantic Segmentation on Icosahedron Spherescited by 53
  8. 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 42
  9. 2018Self-Supervised Learning of Depth and Camera Motion from 360deg Videoscited by 40
  10. 2019Deep Floor Plan Recognition Using a Multi-Task Network with Room-Boundary-Guided Attentioncited by 27
  11. 2022PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenescited by 22
  12. 2019What's in my Room? Object Recognition on Indoor Panoramic Imagescited by 16
  13. 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenescited by 13
  14. 2020Deep Lighting Environment Map Estimation from Spherical Panoramascited by 9
  15. 2020No Shadow Left Behind: Removing Objects and their Shadows using Approximate Lighting and Geometrycited by 9
  16. 2021Towards Full-to-Empty Room Generation with Structure-Aware Feature Encoding and Soft Semantic Region-Adaptive Normalizationcited by 4
  17. 2022Learning Continuous Implicit Representation for Near-Periodic Patternscited by 4
  18. 2022Semantically Supervised Appearance Decomposition for Virtual Staging from a Single Panoramacited by 2
  19. 2022Layout Aware Inpainting for Automated Furniture Removal in Indoor Scenescited by 2

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 2; 2025: 2; 2026: 1.

5 papers.

  1. 2024An Empty Room is All We Want: Automatic Defurnishing of Indoor Panoramascited by 4
  2. 2026SceneNAT: Masked Generative Modeling for Language-Guided Indoor Scene Synthesiscited by 2
  3. 2024Evaluating Panoramic 3D Estimation in Indoor Lighting Analysiscited by 0
  4. 2025Indoor Heat Estimation from a Single Visible-Light Panoramacited by 0
  5. 2025Defurnishing with X-Ray Vision: Joint Removal of Furniture from Panoramas and Meshcited by 0