mlsanityData to 7 Oct 2026

PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Image

arXiv 1812.04072 ↗First posted 10 Dec 2018cs.CVcited by 105

Not on the map. Why?

Abstract (arXiv)

This paper proposes a deep neural architecture, PlaneRCNN, that detects and reconstructs piecewise planar surfaces from a single RGB image. PlaneRCNN employs a variant of Mask R-CNN to detect planes with their plane parameters and segmentation masks. PlaneRCNN then jointly refines all the segmentation masks with a novel loss enforcing the consistency with a nearby view during training. The paper also presents a new benchmark with more fine-grained plane segmentations in the ground-truth, in which, PlaneRCNN outperforms existing state-of-the-art methods with significant margins in the plane detection, segmentation, and reconstruction metrics. PlaneRCNN makes an important step towards robust plane extraction, which would have an immediate impact on a wide range of applications including Robotics, Augmented Reality, and Virtual Reality.

Key facts. Cited by 105 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Dec 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 19; 2022: 25; 2023: 23; 2024: 20; 2025: 10; 2026: 8.

105 papers.

Sort:

By area:

  1. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  2. 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
  3. 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
  4. 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
  5. 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 95
  6. 2022Learning-based Inverse Rendering of Complex Indoor Scenes with Differentiable Monte Carlo Raytracingcited by 78
  7. 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
  8. 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 71
  9. 2022IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenescited by 62
  10. 2024AffordanceLLM: Grounding Affordance from Vision Language Modelscited by 55
  11. 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
  12. 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 43
38 more
  1. 2021Planar Surface Reconstruction from Sparse Viewscited by 40
  2. 2021Towards Real-World Category-level Articulation Pose Estimationcited by 39
  3. 2021StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimationcited by 36
  4. 2022Understanding 3D Object Articulation in Internet Videoscited by 36
  5. 2021PlaneTR: Structure-Guided Transformers for 3D Plane Recoverycited by 33
  6. 2023Understanding 3D Object Interaction from a Single Imagecited by 33
  7. 2023A General Protocol to Probe Large Vision Models for 3D Physical Understandingcited by 32
  8. 2022PlaneMVS: 3D Plane Reconstruction from Multi-View Stereocited by 29
  9. 2022PlanarRecon: Real-time 3D Plane Detection and Reconstruction from Posed Monocular Videoscited by 27
  10. 2022PlaneFormers: From Sparse View Planes to 3D Reconstructioncited by 26
  11. 2024Matching 2D Images in 3D: Metric Relative Pose from Metric Correspondencescited by 25
  12. 2021Fully Convolutional Line Parsingcited by 24
  13. 2022NeurMiPs: Neural Mixture of Planar Experts for View Synthesiscited by 23
  14. 2022NOPE-SAC: Neural One-Plane RANSAC for Sparse-View Planar 3D Reconstructioncited by 21
  15. 2021RoRD: Rotation-Robust Descriptors and Orthographic Views for Local Feature Matchingcited by 19
  16. 2022From 2D to 3D: Re-thinking Benchmarking of Monocular Depth Predictioncited by 19
  17. 2022Unsupervised Homography Estimation with Coplanarity-Aware GANcited by 19
  18. 2024Learning-based Multi-View Stereo: A Surveycited by 18
  19. 2021Cuboids Revisited: Learning Robust 3D Shape Fitting to Single RGB Imagescited by 17
  20. 2022Structure PLP-SLAM: Efficient Sparse Mapping and Localization using Point, Line and Plane for Monocular, RGB-D and Stereo Camerascited by 16
  21. 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaversecited by 14
  22. 2021Mirror3D: Depth Refinement for Mirror Surfacescited by 13
  23. 2024AirPlanes: Accurate Plane Estimation via 3D-Consistent Embeddingscited by 13
  24. 2024PlanarSplatting: Accurate Planar Surface Reconstruction in 3 Minutescited by 13
  25. 2021PLNet: Plane and Line Priors for Unsupervised Indoor Depth Estimationcited by 12
  26. 2023Structural Multiplane Image: Bridging Neural View Synthesis and 3D Reconstructioncited by 12
  27. 2023SuperPrimitive: Scene Reconstruction at a Primitive Levelcited by 11
  28. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Priorcited by 10
  29. 2021Indoor Panorama Planar 3D Reconstruction via Divide and Conquercited by 9
  30. 2021PlaneRecNet: Multi-Task Learning with Cross-Task Consistency for Piece-Wise Plane Detection and Reconstruction from a Single RGB Imagecited by 8
  31. 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimation and Completioncited by 8
  32. 2021PlaneSegNet: Fast and Robust Plane Estimation Using a Single-stage Instance Segmentation CNNcited by 7
  33. 2021Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Imagecited by 7
  34. 2022Egocentric Scene Understanding via Multimodal Spatial Rectifiercited by 7
  35. 2021Lightweight Monocular Depth with a Novel Neural Architecture Search Methodcited by 6
  36. 20223D Scene Inference from Transient Histogramscited by 6
  37. 2022Leveraging Image Matching Toward End-to-End Relative Camera Pose Regressioncited by 6
  38. 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Imagescited by 6

50 most cited of 105 All 105 (JSON)