Improving Worst Case Visual Localization Coverage via Place-specific Sub-selection in Multi-camera Systems
Not on the map. Why?
Abstract (arXiv)
6-DoF visual localization systems utilize principled approaches rooted in 3D geometry to perform accurate camera pose estimation of images to a map. Current techniques use hierarchical pipelines and learned 2D feature extractors to improve scalability and increase performance. However, despite gains in typical [email protected] type metrics, these systems still have limited utility for real-world applications like autonomous vehicles because of their `worst' areas of performance - the locations where they provide insufficient recall at a certain required error tolerance. Here we investigate the utility of using `place specific configurations', where a map is segmented into a number of places, each with its own configuration for modulating the pose estimation step, in this case selecting a camera within a multi-camera system. On the Ford AV benchmark dataset, we demonstrate substantially improved worst-case localization performance compared to using off-the-shelf pipelines - minimizing the percentage of the dataset which has low recall at a certain error tolerance, as well as improved overall localization performance. Our proposed approach is particularly applicable to the crowdsharing model of autonomous vehicle deployment, where a fleet of AVs are regularly traversing a known route.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 28 Jun 2022.
Builds on
33 of 62 references.
References · 33
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
- 2019R2D2: Repeatable and Reliable Detector and Descriptorcited by 206
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 184
- 2018Neighbourhood Consensus Networkscited by 173
- 2019Hierarchical Scene Coordinate Classification and Regression for Visual Localizationcited by 93
21 more
- 2019Deep Declarative Networks: A New Hopecited by 77
- 2020Robust Image Retrieval-based Visual Localization using Kapturecited by 66
- 2018VLocNet++: Deep Multitask Learning for Semantic Visual Localization and Odometrycited by 61
- 2019To Learn or Not to Learn: Visual Localization from Essential Matricescited by 61
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2019Scalable Place Recognition Under Appearance Change for Autonomous Drivingcited by 42
- 2020Benchmarking Image Retrieval for Visual Localizationcited by 42
- 2020Ford Multi-AV Seasonal Datasetcited by 39
- 2020Solving the Blind Perspective-n-Point Problem End-To-End With Robust Differentiable Geometric Optimizationcited by 38
- 2019GN-Net: The Gauss-Newton Loss for Multi-Weather Relocalizationcited by 32
- 2017Robust and Precise Vehicle Localization based on Multi-sensor Fusion in Diverse City Scenescited by 24
- 2019Is This The Right Place? Geometric-Semantic Pose Verification for Indoor Visual Localizationcited by 17
- 2020Intelligent Reference Curation for Visual Place Recognition via Bayesian Selective Fusioncited by 17
- 2019Localization Requirements for Autonomous Vehiclescited by 16
- 2021A Hierarchical Dual Model of Environment- and Place-Specific Utility for Visual Place Recognitioncited by 15
- 2018Efficient 2D-3D Matching for Multi-Camera Visual Localizationcited by 10
- 2020Aerial Imagery based LIDAR Localization for Autonomous Vehiclescited by 10
- 2018Map Management for Efficient Long-Term Visual Localization in Outdoor Environmentscited by 4
- 2018Appearance-Based Landmark Selection for Efficient Long-Term Visual Localizationcited by 3
- 2021S-BEV: Semantic Birds-Eye View Representation for Weather and Lighting Invariant 3-DoF Localizationcited by 3
- 2017Ground Edge based LIDAR Localization without a Reflectivity Calibration for Autonomous Drivingcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 0; 2026: 1.
5 papers.
- 2022Satellite Image Based Cross-view Localization for Autonomous Vehiclecited by 19
- 2023Stereo Visual Odometry with Deep Learning-Based Point and Line Feature Matching using an Attention Graph Neural Networkcited by 3
- 2024Dynamically Modulating Visual Place Recognition Sequence Length For Minimum Acceptable Performance Scenarioscited by 2
- 2023Locking On: Leveraging Dynamic Vehicle-Imposed Motion Constraints to Improve Visual Localizationcited by 0
- 2026DisPlace: Discriminative Place Projections for Multi-Reference Visual Place Recognitioncited by 0
- 2026DisPlace: Discriminative Place Projections for Multi-Reference Visual Place Recognition29 May 2026
- 2024Dynamically Modulating Visual Place Recognition Sequence Length For Minimum Acceptable Performance Scenarios1 Jul 2024
- 2023Stereo Visual Odometry with Deep Learning-Based Point and Line Feature Matching using an Attention Graph Neural Network2 Aug 2023
- 2023Locking On: Leveraging Dynamic Vehicle-Imposed Motion Constraints to Improve Visual Localization30 Jun 2023
- 2022Satellite Image Based Cross-view Localization for Autonomous Vehicle27 Jul 2022