mlsanityData to 14 Oct 2026

LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Image

arXiv 1803.08999 ↗First posted 23 Mar 2018cs.CV cs.AIcited by 95

Not on the map. Why?

Abstract (arXiv)

We propose an algorithm to predict room layout from a single image that generalizes across panoramas and perspective images, cuboid layouts and more general layouts (e.g. L-shape room). Our method operates directly on the panoramic image, rather than decomposing into perspective images as do recent works. Our network architecture is similar to that of RoomNet, but we show improvements due to aligning the image based on vanishing points, predicting multiple layout elements (corners, boundaries, size and translation), and fitting a constrained Manhattan layout to the resulting predictions. Our method compares well in speed and accuracy to other existing work on panoramas, achieves among the best accuracy for perspective images, and can handle both cuboid-shaped and more general Manhattan layouts.

Key facts. Cited by 95 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Mar 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 23; 2022: 21; 2023: 19; 2024: 10; 2025: 13; 2026: 9.

95 papers.

Sort:

By area:

  1. 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
  2. 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 96
  3. 2024Volumetric Environment Representation for Vision-Language Navigationcited by 63
  4. 2022SceneRF: Self-Supervised Monocular 3D Scene Reconstruction with Radiance Fieldscited by 49
  5. 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 44
  6. 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 43
  7. 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 43
  8. 2021Planar Surface Reconstruction from Sparse Viewscited by 40
  9. 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
  10. 2023PolyDiffuse: Polygonal Shape Reconstruction via Guided Set Diffusion Modelscited by 38
  11. 2021PC2WF: 3D Wireframe Reconstruction from Raw Point Cloudscited by 33
  12. 2021DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimizationcited by 33
38 more
  1. 2021HEAT: Holistic Edge Attention Transformer for Structured Reconstructioncited by 29
  2. 2022LGT-Net: Indoor Panoramic Room Layout Estimation with Geometry-Aware Transformer Networkcited by 29
  3. 2021MonteFloor: Extending MCTS for Reconstructing Accurate Large-Scale Floor Planscited by 26
  4. 2024RoboHop: Segment-based Topological Map Representation for Open-World Visual Navigationcited by 25
  5. 2021Fully Convolutional Line Parsingcited by 24
  6. 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 24
  7. 2022360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360^circ Radiance Fieldscited by 20
  8. 2023PanoSwin: a Pano-style Swin Transformer for Panorama Understandingcited by 20
  9. 2021Monte Carlo Scene Search for 3D Scene Understandingcited by 19
  10. 2023PanelNet: Understanding 360 Indoor Environment via Panel Representationcited by 19
  11. 2023PanoContext-Former: Panoramic Total Scene Understanding with a Transformercited by 19
  12. 2025Thinking with Camera: A Unified Multimodal Model for Camera-Centric Understanding and Generationcited by 19
  13. 2021Outdoor inverse rendering from a single image using multiview self-supervisioncited by 18
  14. 2021Plan2Scene: Converting Floorplans to 3D Scenescited by 17
  15. 2021Layout-Guided Novel View Synthesis from a Single Indoor Panoramacited by 16
  16. 2022GLPanoDepth: Global-to-Local Panoramic Depth Estimationcited by 16
  17. 2023Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awarenesscited by 14
  18. 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenescited by 13
  19. 2022Editable Indoor Lighting Estimationcited by 12
  20. 2022PSMNet: Position-aware Stereo Merging Network for Room Layout Estimationcited by 11
  21. 20223D Room Layout Estimation from a Cubemap of Panorama Image via Deep Manhattan Hough Transformcited by 11
  22. 2022High-Resolution Depth Estimation for 360-degree Panoramas through Perspective and Panoramic Depth Images Registrationcited by 11
  23. 20243D Scene Geometry Estimation from 360^circ Imagery: A Surveycited by 11
  24. 2022GPR-Net: Multi-view Layout Estimation via a Geometry-aware Panorama Registration Networkcited by 10
  25. 2021SSLayout360: Semi-Supervised Indoor Layout Estimation from 360-Degree Panoramacited by 9
  26. 2021Indoor Panorama Planar 3D Reconstruction via Divide and Conquercited by 9
  27. 2021OmniLayout: Room Layout Reconstruction from Indoor Spherical Panoramascited by 8
  28. 2023Chat2Map: Efficient Scene Mapping from Multi-Ego Conversationscited by 8
  29. 2021Single-Shot Cuboids: Geodesics-based End-to-end Manhattan Aligned Layout Estimation from Spherical Panoramascited by 7
  30. 2021Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Imagecited by 7
  31. 2022Neural Rendering in a Room: Amodal 3D Understanding and Free-Viewpoint Rendering for the Closed Scene Composed of Pre-Captured Objectscited by 7
  32. 2022SphereDepth: Panorama Depth Estimation from Spherical Domaincited by 7
  33. 2023RDFC-GAN: RGB-Depth Fusion CycleGAN for Indoor Depth Completioncited by 7
  34. 2023Convex Decomposition of Indoor Scenescited by 7
  35. 2021MVLayoutNet:3D layout reconstruction with multi-view panoramascited by 6
  36. 2023Estimating Generic 3D Room Structures from 2D Annotationscited by 6
  37. 2024PARSAC: Accelerating Robust Multi-Model Fitting with Parallel Sample Consensuscited by 6
  38. 2023Virtual Home Staging: Inverse Rendering and Editing an Indoor Panorama under Natural Illuminationcited by 5

50 most cited of 95 All 95 (JSON)