A Probabilistic Framework for Visual Localization in Ambiguous Scenes
Not on the map. Why?
Abstract (arXiv)
Visual localization allows autonomous robots to relocalize when losing track of their pose by matching their current observation with past ones. However, ambiguous scenes pose a challenge for such systems, as repetitive structures can be viewed from many distinct, equally likely camera poses, which means it is not sufficient to produce a single best pose hypothesis. In this work, we propose a probabilistic framework that for a given image predicts the arbitrarily shaped posterior distribution of its camera pose. We do this via a novel formulation of camera pose regression using variational inference, which allows sampling from the predicted distribution. Our method outperforms existing methods on localization in ambiguous scenes. Code and data will be released at https://github.com/efreidun/vapor.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 24 of its 39 references that are in the map. First posted on arXiv 5 Jan 2023.
Builds on
24 of 39 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
12 more
- 2016Image-based localization using LSTMs for structured feature correlationcited by 136
- 2015Modelling Uncertainty in Deep Learning for Camera Relocalizationcited by 133
- 2021LENS: Localization enhanced by NeRF synthesiscited by 116
- 2017Deep Learning Features at Scale for Visual Place Recognitioncited by 96
- 2019Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Predictioncited by 96
- 2021Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation Manifoldcited by 65
- 2021Direct-PoseNet: Absolute Pose Regression with Photometric Consistencycited by 61
- 2017VidLoc: A Deep Spatio-Temporal Model for 6-DoF Video-Clip Relocalizationcited by 58
- 2020Deep Bingham Networks: Dealing with Uncertainty and Ambiguity in Pose Estimationcited by 43
- 2021CoordiNet: uncertainty-aware pose regressor for reliable vehicle localizationcited by 34
- 2021Reassessing the Limitations of CNN Methods for Camera Pose Regressioncited by 19
- 2021MILIOM: Tightly Coupled Multi-Input Lidar-Inertia Odometry and Mappingcited by 1
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 3; 2026: 1.
12 papers.
- 2024Around the World in 80 Timesteps: A Generative Approach to Global Visual Geolocationcited by 23
- 2024HR-APR: APR-agnostic Framework with Uncertainty Estimation and Hierarchical Refinement for Camera Relocalisationcited by 16
- 2023Fusing Structure from Motion and Simulation-Augmented Pose Regression from Optical Flow for Challenging Indoor Environmentscited by 5
- 2026EAGOR: Embodied Reasoning in Omni-directioncited by 3
- 2024Conditional Variational Autoencoders for Probabilistic Pose Regressioncited by 2
- 2024MobileARLoc: On-device Robust Absolute Localisation for Pervasive Markerless Mobile ARcited by 1
- 2023Robust Localization with Visual-Inertial Odometry Constraints for Markerless Mobile ARcited by 0
- 2023KS-APR: Keyframe Selection for Robust Absolute Pose Regressioncited by 0
- 2024PoseINN: Realtime Visual-based Pose Regression and Localization with Invertible Neural Networkscited by 0
- 2025Quantifying Epistemic Uncertainty in Absolute Pose Regressioncited by 0
- 2025Semantic and Feature Guided Uncertainty Quantification of Visual Localization for Autonomous Vehiclescited by 0
- 2025Visible Structure Retrieval for Lightweight Image-Based Relocalisationcited by 0
- 2026EAGOR: Embodied Reasoning in Omni-direction7 Jul 2026
- 2025Visible Structure Retrieval for Lightweight Image-Based Relocalisation16 Nov 2025
- 2025Semantic and Feature Guided Uncertainty Quantification of Visual Localization for Autonomous Vehicles18 Jun 2025
- 2025Quantifying Epistemic Uncertainty in Absolute Pose Regression9 Apr 2025
- 2024Around the World in 80 Timesteps: A Generative Approach to Global Visual Geolocation9 Dec 2024
- 2024Conditional Variational Autoencoders for Probabilistic Pose Regression7 Oct 2024
- 2024PoseINN: Realtime Visual-based Pose Regression and Localization with Invertible Neural Networks20 Apr 2024
- 2024HR-APR: APR-agnostic Framework with Uncertainty Estimation and Hierarchical Refinement for Camera Relocalisation22 Feb 2024
- 2024MobileARLoc: On-device Robust Absolute Localisation for Pervasive Markerless Mobile AR21 Jan 2024
- 2023KS-APR: Keyframe Selection for Robust Absolute Pose Regression10 Aug 2023
- 2023Robust Localization with Visual-Inertial Odometry Constraints for Markerless Mobile AR10 Aug 2023
- 2023Fusing Structure from Motion and Simulation-Augmented Pose Regression from Optical Flow for Challenging Indoor Environments14 Apr 2023