From Coarse to Fine: Robust Hierarchical Localization at Large Scale
Not on the map. Why?
Abstract (arXiv)
Robust and accurate visual localization is a fundamental capability for numerous applications, such as autonomous driving, mobile robotics, or augmented reality. It remains, however, a challenging task, particularly for large-scale environments and in presence of significant appearance changes. State-of-the-art methods not only struggle with such scenarios, but are often too resource intensive for certain real-time applications. In this paper we propose HF-Net, a hierarchical localization approach based on a monolithic CNN that simultaneously predicts local features and global descriptors for accurate 6-DoF localization. We exploit the coarse-to-fine localization paradigm: we first perform a global retrieval to obtain location hypotheses and only later match local features within those candidate places. This hierarchical approach incurs significant runtime savings and makes our system suitable for real-time operation. By leveraging learned descriptors, our method achieves remarkable localization robustness across large variations of appearance and sets a new state-of-the-art on two challenging benchmarks for large-scale localization.
Key facts. Cited by 559 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 57; 2022: 77; 2023: 101; 2024: 121; 2025: 122; 2026: 81.
559 papers.
Sort:
By area:
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 171
38 more
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 161
- 2022OnePose: One-Shot Object Pose Estimation without CAD Modelscited by 157
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 152
- 2023PoseDiffusion: Solving Pose Estimation via Diffusion-aided Bundle Adjustmentcited by 147
- 2021Human POSEitioning System (HPS): 3D Human Pose Estimation and Self-localization in Large Scenes from Body-Mounted Sensorscited by 137
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 131
- 2022MatchFormer: Interleaving Attention in Transformers for Feature Matchingcited by 126
- 2024Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speedcited by 120
- 2023OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Modelscited by 115
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 114
- 2024XFeat: Accelerated Features for Lightweight Image Matchingcited by 113
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2023Accelerated Coordinate Encoding: Learning to Relocalize in Minutes using RGB and Posescited by 107
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2022RelPose: Predicting Probabilistic Relative Rotation for Single Objects in the Wildcited by 102
- 2022LaMAR: Benchmarking Localization and Mapping for Augmented Realitycited by 100
- 2023RelPose++: Recovering 6D Poses from Sparse-view Observationscited by 87
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2021Where is your place, Visual Place Recognition?cited by 82
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 82
- 2024Local All-Pair Correspondence for Point Trackingcited by 80
- 2023HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Videocited by 78
- 2024Scene Coordinate Reconstruction: Posing of Image Collections via Incremental Learning of a Relocalizercited by 73
- 2024How NeRFs and 3D Gaussian Splatting are Reshaping SLAM: a Surveycited by 72
- 2025Pow3R: Empowering Unconstrained 3D Reconstruction with Camera and Scene Priorscited by 72
- 2022ViewFormer: NeRF-free Neural Rendering from Few Images Using Transformerscited by 70
- 2023GlueStick: Robust Image Matching by Sticking Points and Lines Togethercited by 66
- 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisationcited by 63
- 2022ClusterGNN: Cluster-based Coarse-to-Fine Graph Neural Network for Efficient Feature Matchingcited by 62
- 2022MeshLoc: Mesh-Based Visual Localizationcited by 62
- 2022DeepLSD: Line Segment Detection and Refinement with Deep Image Gradientscited by 60
- 2024LoopSplat: Loop Closure by Registering 3D Gaussian Splatscited by 60
- 2025MegaLoc: One Retrieval to Place Them Allcited by 60
- 2021SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognitioncited by 57
- 2021DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Featurescited by 54
- 2022CATs++: Boosting Cost Aggregation with Convolutions and Transformerscited by 53
50 most cited of 559 All 559 (JSON)
- 2026Recovering from Pose-Selection Failures in Repeated Visual Localization12 Oct 2026
- 2026FreeLoc: Online Floorplan Localization via Diffusion-Aided Pose Refinement4 Oct 2026
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation26 Sep 2026
- 2026MAVP: Map-Aware Visuomotor Policies for Mobile Manipulation22 Sep 2026
- 2026NaCR: Visual Localization via NeRF-aided Camera Ray Regression22 Sep 2026
- 2026VideoReloc: Long-Term Indoor Video Relocalization against a Kilobyte-Scale Semantic Scene Graph18 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026CADSplat: Sparse-View 3D Gaussian Splatting Aided by CAD Models for Robust, Photorealistic Digital-Twin Reconstruction16 Sep 2026
- 2026NOVA-GS: Noise-Aware View-Consistent Gaussian Splatting for Low-Light Novel View Synthesis11 Sep 2026
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
38 more
- 2026Misanthrope: A Privacy-Preserving Keypoint Detector24 Aug 2026
- 2026Gravity-aware partially calibrated absolute pose estimation from affine- or rotation-covariant features20 Aug 2026
- 2026Unified and Efficient Point-Line Local Features20 Aug 2026
- 2026RIPE++: Reinforced Keypoint Learning from Positive Pairs Only20 Aug 2026
- 2026SCAPE: Scenario-Conditioned Simulation-Augmented Policy Evaluation19 Aug 2026
- 2026Cross-View Feature Matching: Survey, Benchmarking, and Foundation-Model Perspectives11 Aug 2026
- 2026GeoUniPR: A Geometry-Consistent Unified Framework for Cross-Modal Place Recognition10 Aug 2026
- 2026XFeat Revisited: Reproducibility and Evaluation of a Lightweight Image Matcher10 Aug 2026
- 2026Semi-Dense Matching Uncertainty Is Not Just Local Confidence9 Aug 2026
- 2026SGFormer: Structure-Guided Transformer for Robust Local Feature Matching4 Aug 2026
- 2026From Uncertainty to Determinism: Coarse-to-Fine Visual Floorplan Localization without Ray Matching29 Jul 2026
- 2026Accuracy potential of visual localization exploiting high-end street-level imagery27 Jul 2026
- 2026Hold-Out Self-Validation Cannot Certify Photogrammetric Accuracy: Saturation and Blindness to Coherent Distortion25 Jul 2026
- 2026Still image and spatial-temporal tomato data enabling detection, segmentation, tracking, and video-instance segmentation using strong and weak labels16 Jul 2026
- 2026Wat3R: Underwater 3D Geometry Learning without Annotations9 Jul 2026
- 2026Computing Monetary Risk Measures in Linear Time6 Jul 2026
- 2026Reference-Induced Consensus for Selective Posed-Reference Visual Localization6 Jul 2026
- 2026PRISM3D: Probabilistic Refinement and Robust Initialization for Physically Consistent Scene Modeling under Extreme Motion Blur4 Jul 2026
- 2026GeoMix: Descriptor-Free Visual Localization via Global Context and Multi-Detector Training2 Jul 2026
- 2026Where Am I? Semantic Map Grounding via Vision-Language Models for Multi-Modal Localization1 Jul 2026
- 2026Practical High-Fidelity Novel-View Synthesis of Mounted Lepidoptera30 Jun 2026
- 2026ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos23 Jun 2026
- 2026PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models15 Jun 2026
- 2026SG2Loc: Sequential Visual Localization on 3D Scene Graphs10 Jun 2026
- 2026Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives3 Jun 2026
- 2026City-Mesh3R: Simulation-Ready City-Scale 3D Mesh Reconstruction from Multi-View Images28 May 2026
- 2026Comparative Study of Vision-Based Metric Measurement for Large-Scale Planar Scenes26 May 2026
- 2026Map-Mono-Ego: Map-Grounded Global Human Pose Estimation from Monocular Egocentric Video20 May 2026
- 2026Efficient 3D Content Reconstruction and Generation18 May 2026
- 2026Efficient Sparse-to-Dense Visual Localization via Compact Gaussian Scene Representation and Accelerated Dense Pose Estimation18 May 2026
- 2026DialogueVPR: Towards Conversational Visual Place Recognition8 May 2026
- 2026Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization8 May 2026
- 2026InfoGeo: Information-Theoretic Object-Centric Learning for Cross-View Generalizable UAV Geo-Localization8 May 2026
- 2026egenioussBench: A New Dataset for Geospatial Visual Localisation6 May 2026
- 2026Revisiting Geometric Obfuscation with Dual Convergent Lines for Privacy-Preserving Image Queries in Visual Localization24 Apr 2026
- 2026SceneGlue: Scene-Aware Transformer for Feature Matching without Scene-Level Annotation15 Apr 2026
- 2026Grasp in Gaussians: Fast Monocular Reconstruction of Dynamic Hand-Object Interactions14 Apr 2026
- 2026AsymLoc: Towards Asymmetric Feature Matching for Efficient Visual Localization10 Apr 2026
50 newest of 559 All 559 (JSON)
- 2025MagicHOI: Leveraging 3D Priors for Accurate Hand-object Reconstruction from Short Monocular Video Clipscited by 17
- 2023iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Viewscited by 14
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusioncited by 14
- 2023ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Modelscited by 8
- 2023CaLDiff: Camera Localization in NeRF via Pose Diffusioncited by 2
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimationcited by 0
- 2026QuacamFM: Quaternion-Constrained Flow Matching for Camera Pose Estimation26 Sep 2026
- 2025MagicHOI: Leveraging 3D Priors for Accurate Hand-object Reconstruction from Short Monocular Video Clips7 Aug 2025
- 2025DiffusionSfM: Predicting Structure and Motion via Ray Origin and Endpoint Diffusion8 May 2025
- 2023iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views28 Dec 2023
- 2023CaLDiff: Camera Localization in NeRF via Pose Diffusion23 Dec 2023
- 2023ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models29 Jun 2023
- 2025JamMa: Ultra-lightweight Local Feature Matching with Joint Mambacited by 14
- 2025MambaGlue: Fast and Robust Local Feature Matching With Mambacited by 5
- 2025Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learningcited by 1
- 2025VMatcher: State-Space Semi-Dense Local Feature Matchingcited by 0
- 2025VMatcher: State-Space Semi-Dense Local Feature Matching31 Jul 2025
- 2025Selecting and Pruning: A Differentiable Causal Sequentialized State-Space Model for Two-View Correspondence Learning23 Mar 2025
- 2025JamMa: Ultra-lightweight Local Feature Matching with Joint Mamba5 Mar 2025
- 2025MambaGlue: Fast and Robust Local Feature Matching With Mamba1 Feb 2025
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2023RoMa: Robust Dense Feature Matchingcited by 302
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 200
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021COTR: Correspondence Transformer for Matching Across Imagescited by 183
- 2022DKM: Dense Kernelized Feature Matching for Geometry Estimationcited by 177
- 2022ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformercited by 171
12 most cited of 541 All 541 (JSON)
- 2026Recovering from Pose-Selection Failures in Repeated Visual Localization12 Oct 2026
- 2026FreeLoc: Online Floorplan Localization via Diffusion-Aided Pose Refinement4 Oct 2026
- 2026UltraMatch: Transport Path Routing for Ultra-Fast and Memory-Efficient Image Matching29 Sep 2026
- 2026MAVP: Map-Aware Visuomotor Policies for Mobile Manipulation22 Sep 2026
- 2026NaCR: Visual Localization via NeRF-aided Camera Ray Regression22 Sep 2026
- 2026VideoReloc: Long-Term Indoor Video Relocalization against a Kilobyte-Scale Semantic Scene Graph18 Sep 2026
- 2026RAUL: Reference-Assisted Ureteroscopy Localization for Skill Assessment16 Sep 2026
- 2026CADSplat: Sparse-View 3D Gaussian Splatting Aided by CAD Models for Robust, Photorealistic Digital-Twin Reconstruction16 Sep 2026
- 2026NOVA-GS: Noise-Aware View-Consistent Gaussian Splatting for Low-Light Novel View Synthesis11 Sep 2026
- 2026RoMa-Omega: What Feed-Forward 3D Models Know About Image Matching8 Sep 2026
- 2026AutoCompass: Accurate Visual Localization on Public Maps by Learning from Weak Labels2 Sep 2026
- 2026Misanthrope: A Privacy-Preserving Keypoint Detector24 Aug 2026
12 newest of 541 All 541 (JSON)