# PSMNet: Position-aware Stereo Merging Network for Room Layout Estimation

arXiv: https://arxiv.org/abs/2203.15965 · HTML: https://mlsanity.com/paper/2203.15965/

## Key facts

- Cited by 11 papers in the map (data through 14 Oct 2026).
- Builds on 16 of its 45 references that are in the map.
- First posted on arXiv 30 Mar 2022.

## Builds on (most cited first, 16 of 16)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [Squeeze-and-Excitation Networks](https://mlsanity.com/paper/1709.01507/) (2017)
- [LoFTR: Detector-Free Local Feature Matching with Transformers](https://mlsanity.com/paper/2104.00680/) (2021)
- [Structured3D: A Large Photo-realistic Dataset for Structured 3D Modeling](https://mlsanity.com/paper/1908.00222/) (2019)
- [HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentation](https://mlsanity.com/paper/1901.03861/) (2019)
- [HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Features](https://mlsanity.com/paper/2011.11498/) (2020)
- [LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Image](https://mlsanity.com/paper/1803.08999/) (2018)
- [DuLa-Net: A Dual-Projection Network for Estimating Room Layouts from a Single RGB Panorama](https://mlsanity.com/paper/1811.11977/) (2018)
- [LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Rendering](https://mlsanity.com/paper/2104.00568/) (2021)
- [RoomNet: End-to-End Room Layout Estimation](https://mlsanity.com/paper/1703.06241/) (2017)
- [Floor-SP: Inverse CAD for Floorplans by Sequential Room-wise Shortest Path](https://mlsanity.com/paper/1908.06702/) (2019)
- [FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scans](https://mlsanity.com/paper/1804.00090/) (2018)
- [Floorplan-Jigsaw: Jointly Estimating Scene Layout and Aligning Partial Scans](https://mlsanity.com/paper/1812.06677/) (2018)
- [SSLayout360: Semi-Supervised Indoor Layout Estimation from 360-Degree Panorama](https://mlsanity.com/paper/2103.13696/) (2021)
- [OmniLayout: Room Layout Reconstruction from Indoor Spherical Panoramas](https://mlsanity.com/paper/2104.09403/) (2021)

## Built on by (most cited first, 11 of 11)

- [High-Resolution Depth Estimation for 360-degree Panoramas through Perspective and Panoramic Depth Images Registration](https://mlsanity.com/paper/2210.10414/) (2022)
- [GPR-Net: Multi-view Layout Estimation via a Geometry-aware Panorama Registration Network](https://mlsanity.com/paper/2210.11419/) (2022)
- [Graph-CoVis: GNN-based Multi-view Panorama Global Pose Estimation](https://mlsanity.com/paper/2304.13201/) (2023)
- [360-MLC: Multi-view Layout Consistency for Self-training and Hyper-parameter Tuning](https://mlsanity.com/paper/2210.12935/) (2022)
- [Unposed Sparse Views Room Layout Reconstruction in the Age of Pretrain Model](https://mlsanity.com/paper/2502.16779/) (2025)
- [U2RLE: Uncertainty-Guided 2-Stage Room Layout Estimation](https://mlsanity.com/paper/2304.08580/) (2023)
- [PixCuboid: Room Layout Estimation from Multi-view Featuremetric Alignment](https://mlsanity.com/paper/2508.04659/) (2025)
- [PanoTPS-Net: Panoramic Room Layout Estimation via Thin Plate Spline Transformation](https://mlsanity.com/paper/2510.11992/) (2025)
- [ZeD-MAP: Bundle Adjustment Guided Zero-Shot Depth Maps for Real-Time Aerial Imaging](https://mlsanity.com/paper/2604.04667/) (2026)
- [PolyLayout: Multi-room Manhattan Layout Estimation](https://mlsanity.com/paper/2608.03323/) (2026)
- [MvFFN: Multi-view Floor plan Feed-forward Network for Unposed Wide-Baseline Panorama Layout Reconstruction](https://mlsanity.com/paper/2610.14315/) (2026)

## Abstract (arXiv)

In this paper, we propose a new deep learning-based method for estimating room layout given a pair of 360 panoramas. Our system, called Position-aware Stereo Merging Network or PSMNet, is an end-to-end joint layout-pose estimator. PSMNet consists of a Stereo Pano Pose (SP2) transformer and a novel Cross-Perspective Projection (CP2) layer. The stereo-view SP2 transformer is used to implicitly infer correspondences between views, and can handle noisy poses. The pose-aware CP2 layer is designed to render features from the adjacent view to the anchor (reference) view, in order to perform view fusion and estimate the visible layout. Our experiments and analysis validate our method, which significantly outperforms the state-of-the-art layout estimators, especially for large and complex room spaces.