mlsanityData to 7 Oct 2026

PlanaReLoc: Camera Relocalization in 3D Planar Primitives via Region-Based Structure Matching

arXiv 2603.20818 ↗First posted 21 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

While structure-based relocalizers have long strived for point correspondences when establishing or regressing query-map associations, in this paper, we pioneer the use of planar primitives and 3D planar maps for lightweight 6-DoF camera relocalization in structured environments. Planar primitives, beyond being fundamental entities in projective geometry, also serve as region-based representations that encapsulate both structural and semantic richness. This motivates us to introduce PlanaReLoc, a streamlined plane-centric paradigm where a deep matcher associates planar primitives across the query image and the map within a learned unified embedding space, after which the 6-DoF pose is solved and refined under a robust framework. Through comprehensive experiments on the ScanNet and 12Scenes datasets across hundreds of scenes, our method demonstrates the superiority of planar primitives in facilitating reliable cross-modal structural correspondences and achieving effective camera relocalization without requiring realistically textured/colored maps, pose priors, or per-scene training. The code and data are available at https://github.com/3dv-casia/PlanaReLoc .

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 94 of its 141 references that are in the map. First posted on arXiv 21 Mar 2026.

Builds on

94 of 141 references.

References · 94

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  7. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  8. 2017Mask R-CNNcited by 7,259
  9. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  11. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  12. 2020Supervised Contrastive Learningcited by 2,803
38 more
  1. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  2. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  3. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  4. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  5. 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
  6. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  7. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
  8. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
  9. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  10. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
  11. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  12. 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 381
  13. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  14. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
  15. 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
  16. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
  17. 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
  18. 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
  19. 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
  20. 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 98
  21. 2021Learnable Fourier Features for Multi-Dimensional Spatial Positional Encodingcited by 93
  22. 2023GeoTransformer: Fast and Robust Point Cloud Registration with Geometric Transformercited by 83
  23. 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
  24. 2018PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Imagecited by 77
  25. 2019Expert Sample Consensus Applied to Camera Re-Localizationcited by 70
  26. 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 65
  27. 2016Learning to Navigate the Energy Landscapecited by 62
  28. 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
  29. 2019Single-Image Piece-wise Planar 3D Reconstruction via Associative Embeddingcited by 56
  30. 2017Semantic Visual Localizationcited by 54
  31. 2024Matching Anything by Segmenting Anythingcited by 49
  32. 2022Is Geometry Enough for Matching in Visual Localization?cited by 48
  33. 2023CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representationcited by 45
  34. 2024SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Realitycited by 42
  35. 2018Hybrid Scene Compression for Visual Localizationcited by 40
  36. 2021Tangent Space Backpropagation for 3D Transformation Groupscited by 40
  37. 2021Planar Surface Reconstruction from Sparse Viewscited by 40
  38. 2025MatchAnything: Universal Cross-Modality Image Matching with Large-Scale Pre-Trainingcited by 40

50 most cited of 94 All 94 (JSON)

Built on by

Not cited yet.