mlsanityData to 7 Oct 2026

Planar Surface Reconstruction from Sparse Views

arXiv 2103.14644 ↗First posted 26 Mar 2021cs.CVcited by 40

Not on the map. Why?

Abstract (arXiv)

The paper studies planar surface reconstruction of indoor scenes from two views with unknown camera poses. While prior approaches have successfully created object-centric reconstructions of many scenes, they fail to exploit other structures, such as planes, which are typically the dominant components of indoor scenes. In this paper, we reconstruct planar surfaces from multiple views, while jointly estimating camera pose. Our experiments demonstrate that our method is able to advance the state of the art of reconstruction from sparse views, on challenging scenes from Matterport3D. Project site: https://jinlinyi.github.io/SparsePlanes/

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Builds on 47 of its 72 references that are in the map. First posted on arXiv 26 Mar 2021.

Builds on

47 of 72 references.

References · 47

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2017Mask R-CNNcited by 7,259
  5. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  7. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  8. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  9. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  10. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  11. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  12. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
35 more
  1. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  2. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  3. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  4. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  5. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  6. 2019Learning Correspondence from the Cycle-Consistency of Timecited by 269
  7. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  8. 2017Working hard to know your neighbor's margins: Local descriptor learning losscited by 212
  9. 2016DeMoN: Depth and Motion Network for Learning Monocular Stereocited by 200
  10. 2017Learning a Multi-View Stereo Machinecited by 194
  11. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  12. 2018Neighbourhood Consensus Networkscited by 173
  13. 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 170
  14. 2019Key.Net: Keypoint Detection by Handcrafted and Learned CNN Filterscited by 117
  15. 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 107
  16. 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
  17. 2015Render for CNN: Viewpoint Estimation in Images Using CNNs Trained with Rendered 3D Model Viewscited by 94
  18. 2018LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Imagecited by 94
  19. 2018PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Imagecited by 77
  20. 2018DuLa-Net: A Dual-Projection Network for Estimating Room Layouts from a Single RGB Panoramacited by 67
  21. 2020OASIS: A Large-Scale Dataset for Single Image 3D in the Wildcited by 62
  22. 2014Designing Deep Networks for Surface Normal Estimationcited by 59
  23. 2014Viewpoints and Keypointscited by 59
  24. 2019Single-Image Piece-wise Planar 3D Reconstruction via Associative Embeddingcited by 56
  25. 2017Factoring Shape, Pose, and Layout from the 2D Image of a 3D Scenecited by 50
  26. 2021UnsupervisedR&R: Unsupervised Point Cloud Registration via Differentiable Renderingcited by 44
  27. 2016Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networkscited by 35
  28. 2018RPNet: an End-to-End Network for Relative Camera Pose Estimationcited by 31
  29. 20193D-RelNet: Joint Object and Relational Network for 3D Predictioncited by 28
  30. 2015WxBS: Wide Baseline Stereo Generalizationscited by 23
  31. 2019Extreme Relative Pose Network under Hybrid Representationscited by 19
  32. 2020Associative3D: Volumetric Reconstruction from Sparse Viewscited by 18
  33. 2018Deep Fundamental Matrix Estimation without Correspondencescited by 14
  34. 2020MessyTable: Instance Association in Multiple Camera Viewscited by 13
  35. 2020Novel Object Viewpoint Estimation through Reconstruction Alignmentcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 4; 2022: 9; 2023: 7; 2024: 12; 2025: 6; 2026: 2.

40 papers.

Sort:

  1. 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
  2. 2022The 8-Point Algorithm as an Inductive Bias for Relative Pose Prediction by ViTscited by 38
  3. 2022Understanding 3D Object Articulation in Internet Videoscited by 36
  4. 2023Understanding 3D Object Interaction from a Single Imagecited by 33
  5. 2022PlaneMVS: 3D Plane Reconstruction from Multi-View Stereocited by 29
  6. 2022PlanarRecon: Real-time 3D Plane Detection and Reconstruction from Posed Monocular Videoscited by 27
  7. 2022PlaneFormers: From Sparse View Planes to 3D Reconstructioncited by 26
  8. 2022Virtual Correspondence: Humans as a Cue for Extreme-View Geometrycited by 25
  9. 2022NOPE-SAC: Neural One-Plane RANSAC for Sparse-View Planar 3D Reconstructioncited by 21
  10. 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotationcited by 18
  11. 2022Learning Viewpoint-Agnostic Visual Representations by Recovering Tokens in 3D Spacecited by 13
  12. 2024AirPlanes: Accurate Plane Estimation via 3D-Consistent Embeddingscited by 13
28 more
  1. 2024PlanarSplatting: Accurate Planar Surface Reconstruction in 3 Minutescited by 13
  2. 2023Structural Multiplane Image: Bridging Neural View Synthesis and 3D Reconstructioncited by 12
  3. 2024FAR: Flexible, Accurate and Robust 6DoF Relative Camera Pose Estimationcited by 12
  4. 2021What's Behind the Couch? Directed Ray Distance Functions (DRDF) for 3D Scene Reconstructioncited by 7
  5. 2023RoSI: Recovering 3D Shape Interiors from Few Articulation Imagescited by 6
  6. 2023PlaneRecTR++: Unified Query Learning for Joint 3D Planar Reconstruction and Pose Estimationcited by 6
  7. 20243DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surfacecited by 6
  8. 2024AlphaTablets: A Generic Plane Representation for 3D Planar Reconstruction from Monocular Videoscited by 6
  9. 2024Planar Gaussian Splattingcited by 6
  10. 2025Towards In-the-wild 3D Plane Reconstruction from a Single Imagecited by 6
  11. 2021Visual Correspondence Hallucinationcited by 5
  12. 2021Recognizing Scenes from Novel Viewpointscited by 5
  13. 2023PlanarNeRF: Online Learning of Planar Primitives with Neural Radiance Fieldscited by 5
  14. 2024SRPose: Two-view Relative Pose Estimation with Sparse Keypointscited by 5
  15. 2025PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splattingcited by 5
  16. 2022HM3D-ABO: A Photo-realistic Dataset for Object-centric Multi-view 3D Reconstructioncited by 4
  17. 2024UniPlane: Unified Plane Detection and Reconstruction from Posed Monocular Videoscited by 3
  18. 2025Unposed Sparse Views Room Layout Reconstruction in the Age of Pretrain Modelcited by 3
  19. 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challengescited by 3
  20. 2024Gaussian Splatting in Mirrors: Reflection-Aware Rendering via Virtual Camera Optimizationcited by 2
  21. 2024MonoPlane: Exploiting Monocular Geometric Cues for Generalizable 3D Plane Reconstructioncited by 2
  22. 2025PixCuboid: Room Layout Estimation from Multi-view Featuremetric Alignmentcited by 2
  23. 2024Neural Mesh Fusion: Unsupervised 3D Planar Surface Understandingcited by 1
  24. 2024SALVe: Semantic Alignment Verification for Floorplan Reconstruction from Sparse Panoramascited by 1
  25. 2026Interacted Planes Reveal 3D Line Mappingcited by 1
  26. 2023LoCUS: Learning Multiscale 3D-consistent Features from Posed Imagescited by 0
  27. 2025T-Graph: Enhancing Sparse-view Camera Pose Estimation by Pairwise Translation Graphcited by 0
  28. 2026PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matchingcited by 0