mlsanityData to 14 Oct 2026

PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Image

arXiv 1804.06278 ↗First posted 17 Apr 2018cs.CVcited by 77

Not on the map. Why?

Abstract (arXiv)

This paper proposes a deep neural network (DNN) for piece-wise planar depthmap reconstruction from a single RGB image. While DNNs have brought remarkable progress to single-image depth prediction, piece-wise planar depthmap reconstruction requires a structured geometry representation, and has been a difficult task to master even for DNNs. The proposed end-to-end DNN learns to directly infer a set of plane parameters and corresponding plane segmentation masks from a single RGB image. We have generated more than 50,000 piece-wise planar depthmaps for training and testing from ScanNet, a large-scale RGBD video database. Our qualitative and quantitative evaluations demonstrate that the proposed approach outperforms baseline methods in terms of both plane segmentation and depth estimation accuracy. To the best of our knowledge, this paper presents the first end-to-end neural architecture for piece-wise planar reconstruction from a single RGB image. Code and data are available at https://github.com/art-programmer/PlaneNet.

Key facts. Cited by 77 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 19; 2022: 16; 2023: 19; 2024: 13; 2025: 7; 2026: 3.

77 papers.

Sort:

  1. 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 107
  2. 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
  3. 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
  4. 2021Planar Surface Reconstruction from Sparse Viewscited by 40
  5. 2021StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimationcited by 36
  6. 2022Understanding 3D Object Articulation in Internet Videoscited by 36
  7. 2021PlaneTR: Structure-Guided Transformers for 3D Plane Recoverycited by 33
  8. 2023Understanding 3D Object Interaction from a Single Imagecited by 33
  9. 2022PlaneMVS: 3D Plane Reconstruction from Multi-View Stereocited by 29
  10. 2022PlanarRecon: Real-time 3D Plane Detection and Reconstruction from Posed Monocular Videoscited by 27
  11. 2022PlaneFormers: From Sparse View Planes to 3D Reconstructioncited by 26
  12. 2021Fully Convolutional Line Parsingcited by 24
38 more
  1. 2022Few 'Zero Level Set'-Shot Learning of Shape Signed Distance Functions in Feature Spacecited by 22
  2. 2022NOPE-SAC: Neural One-Plane RANSAC for Sparse-View Planar 3D Reconstructioncited by 21
  3. 2022Unsupervised Homography Estimation with Coplanarity-Aware GANcited by 19
  4. 2021Cuboids Revisited: Learning Robust 3D Shape Fitting to Single RGB Imagescited by 17
  5. 2022Depth Map Decomposition for Monocular Depth Estimationcited by 16
  6. 2024Unsupervised Occupancy Learning from Sparse Point Cloudcited by 15
  7. 2021Mirror3D: Depth Refinement for Mirror Surfacescited by 13
  8. 2024AirPlanes: Accurate Plane Estimation via 3D-Consistent Embeddingscited by 13
  9. 2024PlanarSplatting: Accurate Planar Surface Reconstruction in 3 Minutescited by 13
  10. 2021PLNet: Plane and Line Priors for Unsupervised Indoor Depth Estimationcited by 12
  11. 2023Structural Multiplane Image: Bridging Neural View Synthesis and 3D Reconstructioncited by 12
  12. 2023Mixing-Denoising Generalizable Occupancy Networkscited by 12
  13. 2023SuperPrimitive: Scene Reconstruction at a Primitive Levelcited by 11
  14. 2021Indoor Panorama Planar 3D Reconstruction via Divide and Conquercited by 9
  15. 2022PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimationcited by 9
  16. 2021Boundary-induced and scene-aggregated network for monocular depth predictioncited by 8
  17. 2021PlaneRecNet: Multi-Task Learning with Cross-Task Consistency for Piece-Wise Plane Detection and Reconstruction from a Single RGB Imagecited by 8
  18. 2021PlaneSegNet: Fast and Robust Plane Estimation Using a Single-stage Instance Segmentation CNNcited by 7
  19. 2021Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Imagecited by 7
  20. 2021Lightweight Monocular Depth with a Novel Neural Architecture Search Methodcited by 7
  21. 2022Vision-Based Environmental Perception for Autonomous Drivingcited by 7
  22. 2023Convex Decomposition of Indoor Scenescited by 7
  23. 2023FS-Depth: Focal-and-Scale Depth Estimation from a Single Image in Unseen Indoor Scenecited by 7
  24. 2021Structured Outdoor Architecture Reconstruction by Exploration and Classificationcited by 6
  25. 2022HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Modelcited by 6
  26. 20223D Scene Inference from Transient Histogramscited by 6
  27. 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Imagescited by 6
  28. 2023Estimating Generic 3D Room Structures from 2D Annotationscited by 6
  29. 2023Polygon Detection for Room Layout Estimation using Heterogeneous Graphs and Wireframescited by 6
  30. 2023PlaneRecTR++: Unified Query Learning for Joint 3D Planar Reconstruction and Pose Estimationcited by 6
  31. 2024MonoSelfRecon: Purely Self-Supervised Explicit Generalizable 3D Reconstruction of Indoor Scenes from Monocular RGB Viewscited by 6
  32. 2024AlphaTablets: A Generic Plane Representation for 3D Planar Reconstruction from Monocular Videoscited by 6
  33. 2024Planar Gaussian Splattingcited by 6
  34. 2025Towards In-the-wild 3D Plane Reconstruction from a Single Imagecited by 6
  35. 2023PlanarNeRF: Online Learning of Planar Primitives with Neural Radiance Fieldscited by 5
  36. 2024Masked Spatial Propagation Network for Sparsity-Adaptive Depth Refinementcited by 5
  37. 2025PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splattingcited by 5
  38. 2021Visual SLAM with Graph-Cut Optimized Multi-Plane Reconstructioncited by 4

50 most cited of 77 All 77 (JSON)