Image-based Localization using Hourglass Networks
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose an encoder-decoder convolutional neural network (CNN) architecture for estimating camera pose (orientation and location) from a single RGB-image. The architecture has a hourglass shape consisting of a chain of convolution and up-convolution layers followed by a regression part. The up-convolution layers are introduced to preserve the fine-grained information of the input image. Following the common practice, we train our model in end-to-end manner utilizing transfer learning from large scale classification data. The experiments demonstrate the performance of the approach on data exhibiting different lighting conditions, reflections, and motion blur. The results indicate a clear improvement over the previous state-of-the-art even when compared to methods that utilize sequence of test frames instead of a single frame.
Key facts. Cited by 63 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 13; 2023: 15; 2024: 15; 2025: 6; 2026: 1.
63 papers.
Sort:
By area:
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
- 2023Independent Component Alignment for Multi-Task Learningcited by 69
- 2021Direct-PoseNet: Absolute Pose Regression with Photometric Consistencycited by 61
- 2024Map-Relative Pose Regression for Visual Re-Localizationcited by 42
- 2021Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervisioncited by 37
- 2023Neural Refinement for Absolute Pose Regression with Feature Synthesiscited by 37
- 2021CoordiNet: uncertainty-aware pose regressor for reliable vehicle localizationcited by 34
- 2022Camera Pose Auto-Encoders for Improving Pose Regressioncited by 28
- 2023360Loc: A Dataset and Benchmark for Omnidirectional Visual Localization with Cross-device Queriescited by 28
38 more
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformercited by 26
- 2021Continual Learning for Image-Based Camera Localizationcited by 18
- 2022Leveraging Equivariant Features for Absolute Pose Regressioncited by 17
- 2024HR-APR: APR-agnostic Framework with Uncertainty Estimation and Hierarchical Refinement for Camera Relocalisationcited by 16
- 2021Wide-Baseline Multi-Camera Calibration using Person Re-Identificationcited by 15
- 2023Deep Learning for Visual Localization and Mapping: A Surveycited by 14
- 2024Learning Neural Volumetric Pose Features for Camera Localizationcited by 11
- 2021Paying Attention to Activation Maps in Camera Pose Regressioncited by 10
- 2023EP2P-Loc: End-to-End 3D Point to 2D Pixel Localization for Large-Scale Visual Localizationcited by 8
- 2022A Critical Analysis of Image-based Camera Pose Estimation Techniquescited by 7
- 20213D-Aware Ellipse Prediction for Object-Based Camera Pose Estimationcited by 6
- 2022Semantic Segmentation using Neural Ordinary Differential Equationscited by 6
- 2021Pose-GNN : Camera Pose Estimation System Using Graph Neural Networkscited by 4
- 2022Object-Based Visual Camera Pose Estimation From Ellipsoidal Model and 3D-Aware Ellipse Predictioncited by 4
- 2023Learning to Localize in Unseen Scenes with Relative Pose Regressorscited by 3
- 2021TransCamP: Graph Transformer for 6-DoF Camera Pose Estimationcited by 2
- 2022Objects Matter: Learning Object Relation Graph for Robust Camera Relocalizationcited by 2
- 2022Benchmarking Visual-Inertial Deep Multimodal Fusion for Relative Pose Regression and Odometry-aided Absolute Pose Regressioncited by 2
- 2023FusionLoc: Camera-2D LiDAR Fusion Using Multi-Head Self-Attention for End-to-End Serving Robot Relocalizationcited by 2
- 2023CoPR: Towards Accurate Visual Localization With Continuous Place-descriptor Regressioncited by 2
- 2024Conditional Variational Autoencoders for Probabilistic Pose Regressioncited by 2
- 2024NaVIP: An Image-Centric Indoor Navigation Solution for Visually Impaired Peoplecited by 2
- 2022Pixel-Wise Prediction based Visual Odometry via Uncertainty Estimationcited by 1
- 2022A Lightweight Domain Adaptive Absolute Pose Regressor Using Barlow Twins Objectivecited by 1
- 2023HyperPose: Hypernetwork-Infused Camera Pose Localization and an Extended Cambridge Landmarks Datasetcited by 1
- 2023Global Localization: Utilizing Relative Spatio-Temporal Geometric Constraints from Adjacent and Distant Camerascited by 1
- 2024MobileARLoc: On-device Robust Absolute Localisation for Pervasive Markerless Mobile ARcited by 1
- 2024On the Effect of Image Resolution on Semantic Segmentationcited by 1
- 2024Camera Relocalization in Shadow-free Neural Radiance Fieldscited by 1
- 2024Enhancing Scene Coordinate Regression with Efficient Keypoint Detection and Sequential Informationcited by 1
- 2025MVL-Loc: Leveraging Vision-Language Model for Generalizable Multi-Scene Camera Relocalizationcited by 1
- 2021Deep Weakly Supervised Positioningcited by 0
- 2021Deep auxiliary learning for visual localization using colorization taskcited by 0
- 2022Deep Camera Pose Regression Using Pseudo-LiDARcited by 0
- 2022S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalizationcited by 0
- 2022Graph Attention Network for Camera Relocalization on Dynamic Scenescited by 0
- 2023Synfeal: A Data-Driven Simulator for End-to-End Camera Localizationcited by 0
- 2023Robust Localization with Visual-Inertial Odometry Constraints for Markerless Mobile ARcited by 0
50 most cited of 63 All 63 (JSON)
- 2026Robust Localization for Autonomous Vehicles in Highway Scenes23 Apr 2026
- 2025Visible Structure Retrieval for Lightweight Image-Based Relocalisation16 Nov 2025
- 2025Relative Pose Regression with Pose Auto-Encoders: Enhancing Accuracy and Data Efficiency for Retail Applications12 Aug 2025
- 2025MVL-Loc: Leveraging Vision-Language Model for Generalizable Multi-Scene Camera Relocalization6 Jul 2025
- 2025Robust Visual Localization via Semantic-Guided Multi-Scale Transformer10 Jun 2025
- 2025NeuroLoc: Encoding Navigation Cells for 6-DOF Camera Localization2 May 2025
- 2025Quantifying Epistemic Uncertainty in Absolute Pose Regression9 Apr 2025
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization11 Dec 2024
- 2024Enhancing Scene Coordinate Regression with Efficient Keypoint Detection and Sequential Information9 Dec 2024
- 2024NaVIP: An Image-Centric Indoor Navigation Solution for Visually Impaired People8 Oct 2024
- 2024Conditional Variational Autoencoders for Probabilistic Pose Regression7 Oct 2024
- 2024Map-Free Visual Relocalization Enhanced by Instance Knowledge and Depth Knowledge23 Aug 2024
38 more
- 2024MambaLoc: Efficient Camera Localisation via State Space Model19 Aug 2024
- 2024Camera Relocalization in Shadow-free Neural Radiance Fields23 May 2024
- 2024PoseINN: Realtime Visual-based Pose Regression and Localization with Invertible Neural Networks20 Apr 2024
- 2024Map-Relative Pose Regression for Visual Re-Localization15 Apr 2024
- 2024Learning Neural Volumetric Pose Features for Camera Localization19 Mar 2024
- 2024HR-APR: APR-agnostic Framework with Uncertainty Estimation and Hierarchical Refinement for Camera Relocalisation22 Feb 2024
- 2024Early Fusion of Features for Semantic Segmentation8 Feb 2024
- 2024On the Effect of Image Resolution on Semantic Segmentation8 Feb 2024
- 2024Multi-Scale Semantic Segmentation with Modified MBConv Blocks7 Feb 2024
- 2024MobileARLoc: On-device Robust Absolute Localisation for Pervasive Markerless Mobile AR21 Jan 2024
- 2023Implicit Learning of Scene Geometry from Poses for Global Localization4 Dec 2023
- 2023Global Localization: Utilizing Relative Spatio-Temporal Geometric Constraints from Adjacent and Distant Cameras1 Dec 2023
- 2023360Loc: A Dataset and Benchmark for Omnidirectional Visual Localization with Cross-device Queries29 Nov 2023
- 2023EP2P-Loc: End-to-End 3D Point to 2D Pixel Localization for Large-Scale Visual Localization14 Sep 2023
- 2023Deep Learning for Visual Localization and Mapping: A Survey27 Aug 2023
- 2023KS-APR: Keyframe Selection for Robust Absolute Pose Regression10 Aug 2023
- 2023Robust Localization with Visual-Inertial Odometry Constraints for Markerless Mobile AR10 Aug 2023
- 2023Independent Component Alignment for Multi-Task Learning30 May 2023
- 2023Synfeal: A Data-Driven Simulator for End-to-End Camera Localization29 May 2023
- 2023HSCNet++: Hierarchical Scene Coordinate Classification and Regression for Visual Localization with Transformer5 May 2023
- 2023CoPR: Towards Accurate Visual Localization With Continuous Place-descriptor Regression14 Apr 2023
- 2023Neural Refinement for Absolute Pose Regression with Feature Synthesis17 Mar 2023
- 2023FusionLoc: Camera-2D LiDAR Fusion Using Multi-Head Self-Attention for End-to-End Serving Robot Relocalization13 Mar 2023
- 2023Learning to Localize in Unseen Scenes with Relative Pose Regressors5 Mar 2023
- 2023HyperPose: Hypernetwork-Infused Camera Pose Localization and an Extended Cambridge Landmarks Dataset5 Mar 2023
- 2022A Lightweight Domain Adaptive Absolute Pose Regressor Using Barlow Twins Objective20 Nov 2022
- 2022Graph Attention Network for Camera Relocalization on Dynamic Scenes29 Sep 2022
- 2022Semantic Segmentation using Neural Ordinary Differential Equations18 Sep 2022
- 2022Pixel-Wise Prediction based Visual Odometry via Uncertainty Estimation18 Aug 2022
- 2022Benchmarking Visual-Inertial Deep Multimodal Fusion for Relative Pose Regression and Odometry-aided Absolute Pose Regression1 Aug 2022
- 2022Camera Pose Auto-Encoders for Improving Pose Regression12 Jul 2022
- 2022Objects Matter: Learning Object Relation Graph for Robust Camera Relocalization26 May 2022
- 2022S3E-GNN: Sparse Spatial Scene Embedding with Graph Neural Networks for Camera Relocalization12 May 2022
- 2022Leveraging Equivariant Features for Absolute Pose Regression5 Apr 2022
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matching1 Apr 2022
- 2022Object-Based Visual Camera Pose Estimation From Ellipsoidal Model and 3D-Aware Ellipse Prediction9 Mar 2022
- 2022Deep Camera Pose Regression Using Pseudo-LiDAR28 Feb 2022
- 2022A Critical Analysis of Image-based Camera Pose Estimation Techniques15 Jan 2022
50 newest of 63 All 63 (JSON)
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2022DFNet: Enhance Absolute Pose Regression with Direct Feature Matchingcited by 82
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localizationcited by 81
- 2023Independent Component Alignment for Multi-Task Learningcited by 69
- 2021Direct-PoseNet: Absolute Pose Regression with Photometric Consistencycited by 61
- 2024Map-Relative Pose Regression for Visual Re-Localizationcited by 42
- 2021Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervisioncited by 37
- 2023Neural Refinement for Absolute Pose Regression with Feature Synthesiscited by 37
- 2021CoordiNet: uncertainty-aware pose regressor for reliable vehicle localizationcited by 34
- 2022Camera Pose Auto-Encoders for Improving Pose Regressioncited by 28
- 2023360Loc: A Dataset and Benchmark for Omnidirectional Visual Localization with Cross-device Queriescited by 28
12 most cited of 61 All 61 (JSON)
- 2025Visible Structure Retrieval for Lightweight Image-Based Relocalisation16 Nov 2025
- 2025Relative Pose Regression with Pose Auto-Encoders: Enhancing Accuracy and Data Efficiency for Retail Applications12 Aug 2025
- 2025Robust Visual Localization via Semantic-Guided Multi-Scale Transformer10 Jun 2025
- 2025NeuroLoc: Encoding Navigation Cells for 6-DOF Camera Localization2 May 2025
- 2025Quantifying Epistemic Uncertainty in Absolute Pose Regression9 Apr 2025
- 2024Reloc3r: Large-Scale Training of Relative Camera Pose Regression for Generalizable, Fast, and Accurate Visual Localization11 Dec 2024
- 2024Enhancing Scene Coordinate Regression with Efficient Keypoint Detection and Sequential Information9 Dec 2024
- 2024NaVIP: An Image-Centric Indoor Navigation Solution for Visually Impaired People8 Oct 2024
- 2024Conditional Variational Autoencoders for Probabilistic Pose Regression7 Oct 2024
- 2024Map-Free Visual Relocalization Enhanced by Instance Knowledge and Depth Knowledge23 Aug 2024
- 2024MambaLoc: Efficient Camera Localisation via State Space Model19 Aug 2024
- 2024Camera Relocalization in Shadow-free Neural Radiance Fields23 May 2024
12 newest of 61 All 61 (JSON)