mlsanityData to 14 Oct 2026

HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentation

arXiv 1901.03861 ↗First posted 12 Jan 2019cs.CVcited by 108

Not on the map. Why?

Abstract (arXiv)

We present a new approach to the problem of estimating the 3D room layout from a single panoramic image. We represent room layout as three 1D vectors that encode, at each image column, the boundary positions of floor-wall and ceiling-wall, and the existence of wall-wall boundary. The proposed network, HorizonNet, trained for predicting 1D layout, outperforms previous state-of-the-art approaches. The designed post-processing procedure for recovering 3D room layouts from 1D predictions can automatically infer the room shape with low computation cost - it takes less than 20ms for a panorama image while prior works might need dozens of seconds. We also propose Pano Stretch Data Augmentation, which can diversify panorama data and be applied to other panorama-related learning tasks. Due to the limited data available for non-cuboid layout, we relabel 65 general layout from the current dataset for finetuning. Our approach shows good performance on general layouts by qualitative results and cross-validation.

Key facts. Cited by 108 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Jan 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 23; 2022: 24; 2023: 20; 2024: 17; 2025: 11; 2026: 13.

108 papers.

Sort:

By area:

  1. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  2. 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 95
  3. 2023NDC-Scene: Boost Monocular 3D Semantic Scene Completion in Normalized Device Coordinates Spacecited by 90
  4. 2023Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraintscited by 60
  5. 2022SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fieldscited by 49
  6. 2023Neural-PBIR Reconstruction of Shape, Material, and Illuminationcited by 45
  7. 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 43
  8. 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 43
  9. 2021Planar Surface Reconstruction from Sparse Viewscited by 40
  10. 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
  11. 2021Pano3D: A Holistic Benchmark and a Solid Baseline for 360o Depth Estimationcited by 37
  12. 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
38 more
  1. 2024360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roamingcited by 35
  2. 2021DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimizationcited by 33
  3. 2021LaLaLoc: Latent Layout Localisation in Dynamic, Unvisited Environmentscited by 29
  4. 2022LGT-Net: Indoor Panoramic Room Layout Estimation with Geometry-Aware Transformer Networkcited by 29
  5. 2021MonteFloor: Extending MCTS for Reconstructing Accurate Large-Scale Floor Planscited by 26
  6. 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 24
  7. 2022PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenescited by 22
  8. 2022360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360^circ Radiance Fieldscited by 20
  9. 2023PanoSwin: a Pano-style Swin Transformer for Panorama Understandingcited by 20
  10. 2023AV-RIR: Audio-Visual Room Impulse Response Estimationcited by 20
  11. 2021Monte Carlo Scene Search for 3D Scene Understandingcited by 19
  12. 2021Moving in a 360 World: Synthesizing Panoramic Parallaxes from a Single Panoramacited by 19
  13. 2023PanelNet: Understanding 360 Indoor Environment via Panel Representationcited by 19
  14. 2023PanoContext-Former: Panoramic Total Scene Understanding with a Transformercited by 19
  15. 2021Plan2Scene: Converting Floorplans to 3D Scenescited by 17
  16. 2021Layout-Guided Novel View Synthesis from a Single Indoor Panoramacited by 16
  17. 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
  18. 2023Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awarenesscited by 14
  19. 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenescited by 13
  20. 2022Complementary Bi-directional Feature Compression for Indoor 360deg Semantic Segmentation with Self-distillationcited by 12
  21. 2024Taming Stable Diffusion for Text to 360deg Panorama Image Generationcited by 12
  22. 2022PSMNet: Position-aware Stereo Merging Network for Room Layout Estimationcited by 11
  23. 20223D Room Layout Estimation from a Cubemap of Panorama Image via Deep Manhattan Hough Transformcited by 11
  24. 2022FreDSNet: Joint Monocular Depth and Semantic Segmentation with Fast Fourier Convolutionscited by 11
  25. 2022High-Resolution Depth Estimation for 360-degree Panoramas through Perspective and Panoramic Depth Images Registrationcited by 11
  26. 20243D Scene Geometry Estimation from 360^circ Imagery: A Surveycited by 11
  27. 2022GPR-Net: Multi-view Layout Estimation via a Geometry-aware Panorama Registration Networkcited by 10
  28. 2021SSLayout360: Semi-Supervised Indoor Layout Estimation from 360-Degree Panoramacited by 9
  29. 2021Indoor Panorama Planar 3D Reconstruction via Divide and Conquercited by 9
  30. 2024PolyRoom: Room-aware Transformer for Floorplan Reconstructioncited by 9
  31. 2021OmniLayout: Room Layout Reconstruction from Indoor Spherical Panoramascited by 8
  32. 2021360-DFPE: Leveraging Monocular 360-Layouts for Direct Floor Plan Estimationcited by 8
  33. 2023Chat2Map: Efficient Scene Mapping from Multi-Ego Conversationscited by 8
  34. 2021Single-Shot Cuboids: Geodesics-based End-to-end Manhattan Aligned Layout Estimation from Spherical Panoramascited by 7
  35. 2021Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Imagecited by 7
  36. 2022Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objectscited by 7
  37. 2022SphereDepth: Panorama Depth Estimation from Spherical Domaincited by 7
  38. 2021MVLayoutNet:3D layout reconstruction with multi-view panoramascited by 6

50 most cited of 108 All 108 (JSON)