PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matching
Not on the map. Why?
Abstract (arXiv)
While structure-based relocalizers have long strived for point correspondences when establishing or regressing query-map associations, in this paper, we pioneer the use of planar primitives and 3D planar maps for lightweight 6-DoF camera relocalization in structured environments. Planar primitives, beyond being fundamental entities in projective geometry, also serve as region-based representations that encapsulate both structural and semantic richness. This motivates us to introduce PlanaReLoc, a streamlined plane-centric paradigm where a deep matcher associates planar primitives across the query image and the map within a learned unified embedding space, after which the 6-DoF pose is solved and refined under a robust framework. Through comprehensive experiments on the ScanNet and 12Scenes datasets across hundreds of scenes, our method demonstrates the superiority of planar primitives in facilitating reliable cross-modal structural correspondences and achieving effective camera relocalization without requiring realistically textured/colored maps, pose priors, or per-scene training. The code and data are available at https://github.com/3dv-casia/PlanaReLoc .
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 94 of its 141 references that are in the map. First posted on arXiv 21 Mar 2026.
Builds on
94 of 141 references.
References · 94
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2017Mask R-CNNcited by 7,259
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2020Supervised Contrastive Learningcited by 2,803
38 more
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
- 2021Learnable Fourier Features for Multi-Dimensional Spatial Positional Encodingcited by 93
- 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 83
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
- 2018PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Imagecited by 77
- 2019Expert Sample Consensus Applied to Camera Re-Localizationcited by 70
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 65
- 2016Learning to Navigate the Energy Landscapecited by 62
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2019Single-Image Piece-wise Planar 3D Reconstruction via Associative Embeddingcited by 56
- 2017Semantic Visual Localizationcited by 54
- 2024Matching Anything by Segmenting Anythingcited by 49
- 2022Is Geometry Enough for Matching in Visual Localization?cited by 48
- 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
- 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 42
- 2018Hybrid Scene Compression for Visual Localizationcited by 40
- 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
- 2021Planar Surface Reconstruction from Sparse Viewscited by 40
- 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40
50 most cited of 94 All 94 (JSON)
Built on by
Not cited yet.