mlsanityData to 7 Oct 2026

Improving Worst Case Visual Localization Coverage via Place-specific Sub-selection in Multi-camera Systems

arXiv 2206.13883 ↗First posted 28 Jun 2022cs.RO cs.AI cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

6-DoF visual localization systems utilize principled approaches rooted in 3D geometry to perform accurate camera pose estimation of images to a map. Current techniques use hierarchical pipelines and learned 2D feature extractors to improve scalability and increase performance. However, despite gains in typical [email protected] type metrics, these systems still have limited utility for real-world applications like autonomous vehicles because of their `worst' areas of performance - the locations where they provide insufficient recall at a certain required error tolerance. Here we investigate the utility of using `place specific configurations', where a map is segmented into a number of places, each with its own configuration for modulating the pose estimation step, in this case selecting a camera within a multi-camera system. On the Ford AV benchmark dataset, we demonstrate substantially improved worst-case localization performance compared to using off-the-shelf pipelines - minimizing the percentage of the dataset which has low recall at a certain error tolerance, as well as improved overall localization performance. Our proposed approach is particularly applicable to the crowdsharing model of autonomous vehicle deployment, where a fleet of AVs are regularly traversing a known route.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 28 Jun 2022.

Builds on

33 of 62 references.

References · 33

  1. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  2. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  3. 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
  4. 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
  5. 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
  6. 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
  7. 2019R2D2: Repeatable and Reliable Detector and Descriptorcited by 206
  8. 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
  9. 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
  10. 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 184
  11. 2018Neighbourhood Consensus Networkscited by 173
  12. 2019Hierarchical Scene Coordinate Classification and Regression for Visual Localizationcited by 93
21 more
  1. 2019Deep Declarative Networks: A New Hopecited by 77
  2. 2020Robust Image Retrieval-based Visual Localization using Kapturecited by 66
  3. 2018VLocNet++: Deep Multitask Learning for Semantic Visual Localization and Odometrycited by 61
  4. 2019To Learn or Not to Learn: Visual Localization from Essential Matricescited by 61
  5. 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
  6. 2019Scalable Place Recognition Under Appearance Change for Autonomous Drivingcited by 42
  7. 2020Benchmarking Image Retrieval for Visual Localizationcited by 42
  8. 2020Ford Multi-AV Seasonal Datasetcited by 39
  9. 2020Solving the Blind Perspective-n-Point Problem End-To-End With Robust Differentiable Geometric Optimizationcited by 38
  10. 2019GN-Net: The Gauss-Newton Loss for Multi-Weather Relocalizationcited by 32
  11. 2017Robust and Precise Vehicle Localization based on Multi-sensor Fusion in Diverse City Scenescited by 24
  12. 2019Is This The Right Place? Geometric-Semantic Pose Verification for Indoor Visual Localizationcited by 17
  13. 2020Intelligent Reference Curation for Visual Place Recognition via Bayesian Selective Fusioncited by 17
  14. 2019Localization Requirements for Autonomous Vehiclescited by 16
  15. 2021A Hierarchical Dual Model of Environment- and Place-Specific Utility for Visual Place Recognitioncited by 15
  16. 2018Efficient 2D-3D Matching for Multi-Camera Visual Localizationcited by 10
  17. 2020Aerial Imagery based LIDAR Localization for Autonomous Vehiclescited by 10
  18. 2018Map Management for Efficient Long-Term Visual Localization in Outdoor Environmentscited by 4
  19. 2018Appearance-Based Landmark Selection for Efficient Long-Term Visual Localizationcited by 3
  20. 2021S-BEV: Semantic Birds-Eye View Representation for Weather and Lighting Invariant 3-DoF Localizationcited by 3
  21. 2017Ground Edge based LIDAR Localization without a Reflectivity Calibration for Autonomous Drivingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 1; 2025: 0; 2026: 1.

5 papers.