mlsanityData to 7 Oct 2026

LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Rendering

arXiv 2104.00568 ↗First posted 1 Apr 2021cs.CVcited by 42

Not on the map. Why?

Abstract (arXiv)

Although significant progress has been made in room layout estimation, most methods aim to reduce the loss in the 2D pixel coordinate rather than exploiting the room structure in the 3D space. Towards reconstructing the room layout in 3D, we formulate the task of 360 layout estimation as a problem of predicting depth on the horizon line of a panorama. Specifically, we propose the Differentiable Depth Rendering procedure to make the conversion from layout to depth prediction differentiable, thus making our proposed model end-to-end trainable while leveraging the 3D geometric information, without the need of providing the ground truth depth. Our method achieves state-of-the-art performance on numerous 360 layout benchmark datasets. Moreover, our formulation enables a pre-training step on the depth dataset, which further improves the generalizability of our layout estimation model.

Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). Builds on 17 of its 30 references that are in the map. First posted on arXiv 1 Apr 2021.

Builds on

17 of 30 references.

References · 17

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  4. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  5. 2018Spherical CNNscited by 452
  6. 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
  7. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
  8. 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
  9. 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 107
  10. 2018OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramascited by 98
  11. 2018LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Imagecited by 94
  12. 2018DuLa-Net: A Dual-Projection Network for Estimating Room Layouts from a Single RGB Panoramacited by 67
5 more
  1. 2018Cube Padding for Weakly-Supervised Saliency Prediction in 360deg Videoscited by 66
  2. 2018Kernel Transformer Networks for Compact Spherical Convolutioncited by 56
  3. 2018Self-Supervised Learning of Depth and Camera Motion from 360deg Videoscited by 40
  4. 2019Manhattan Room Layout Reconstruction from a Single 360 image: A Comparative Study of State-of-the-art Methodscited by 11
  5. 2020LayoutMP3D: Layout Annotation of Matterport3Dcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 11; 2023: 11; 2024: 4; 2025: 10; 2026: 2.

42 papers.

Sort:

By area:

  1. 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
  2. 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
  3. 2023HRDFuse: Monocular 360degDepth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributionscited by 37
  4. 2022LGT-Net: Indoor Panoramic Room Layout Estimation with Geometry-Aware Transformer Networkcited by 28
  5. 2022360FusionNeRF: Panoramic Neural Radiance Fields with Joint Guidancecited by 23
  6. 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 23
  7. 2022360Roam: Real-Time Indoor Roaming Using Geometry-Aware 360^circ Radiance Fieldscited by 20
  8. 2023PanelNet: Understanding 360 Indoor Environment via Panel Representationcited by 19
  9. 2023PanoContext-Former: Panoramic Total Scene Understanding with a Transformercited by 19
  10. 2023AdVerb: Visually Guided Audio Dereverberationcited by 15
  11. 2023Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awarenesscited by 14
  12. 20223D Room Layout Estimation from a Cubemap of Panorama Image via Deep Manhattan Hough Transformcited by 11
30 more
  1. 20243D Scene Geometry Estimation from 360^circ Imagery: A Surveycited by 11
  2. 2022PSMNet: Position-aware Stereo Merging Network for Room Layout Estimationcited by 10
  3. 2022High-Resolution Depth Estimation for 360-degree Panoramas through Perspective and Panoramic Depth Images Registrationcited by 10
  4. 2022GPR-Net: Multi-view Layout Estimation via a Geometry-aware Panorama Registration Networkcited by 10
  5. 2021360-DFPE: Leveraging Monocular 360-Layouts for Direct Floor Plan Estimationcited by 8
  6. 2021360deg Optical Flow using Tangent Imagescited by 7
  7. 2021MVLayoutNet:3D layout reconstruction with multi-view panoramascited by 6
  8. 2023Virtual Home Staging: Inverse Rendering and Editing an Indoor Panorama under Natural Illuminationcited by 5
  9. 2023360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perceptioncited by 5
  10. 2022360-MLC: Multi-view Layout Consistency for Self-training and Hyper-parameter Tuningcited by 4
  11. 2024No More Ambiguity in 360deg Room Layout via Bi-Layout Estimationcited by 3
  12. 2024Self-training Room Layout Estimation via Geometry-aware Ray-castingcited by 3
  13. 2022Self-supervised 360circ Room Layout Estimationcited by 2
  14. 2023U2RLE: Uncertainty-Guided 2-Stage Room Layout Estimationcited by 2
  15. 2023Shape-Net: Room Layout Estimation from Panoramic Images Robust to Occlusion using Knowledge Distillation with 3D Shapes as Additional Inputscited by 2
  16. 2023Seg2Reg: Differentiable 2D Segmentation to 1D Regression Rendering for 360 Room Layout Reconstructioncited by 2
  17. 2025OB3D: A New Dataset for Benchmarking Omnidirectional 3D Reconstruction Using Blendercited by 2
  18. 2025PixCuboid: Room Layout Estimation from Multi-view Featuremetric Alignmentcited by 2
  19. 2025BADGR: Bundle Adjustment Diffusion Conditioned by GRadients for Wide-Baseline Floor Plan Reconstructioncited by 1
  20. 2025TUN3D: Towards Real-World Scene Understanding from Unposed Imagescited by 1
  21. 2022PanoViT: Vision Transformer for Room Layout Estimation from a Single Panoramic Imagecited by 0
  22. 2023iBARLE: imBalance-Aware Room Layout Estimationcited by 0
  23. 2024Evaluating Panoramic 3D Estimation in Indoor Lighting Analysiscited by 0
  24. 2025Semi-Supervised 360 Layout Estimation with Panoramic Collaborative Perturbationscited by 0
  25. 2025Panoramic Distortion-Aware Tokenization for Person Detection and Localization in Overhead Fisheye Imagescited by 0
  26. 2025uLayout: Unified Room Layout Estimation for Perspective and Panoramic Imagescited by 0
  27. 2025PAGCNet: A Pose-Aware and Geometry Constrained Framework for Panoramic Depth Estimationcited by 0
  28. 2025PanoTPS-Net: Panoramic Room Layout Estimation via Thin Plate Spline Transformationcited by 0
  29. 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modelingcited by 0
  30. 2026PolyLayout: Multi-room Manhattan Layout Estimationcited by 0