HyperPose: Hypernetwork-Infused Camera Pose Localization and an Extended Cambridge Landmarks Dataset
Not on the map. Why?
Abstract (arXiv)
In this work, we propose HyperPose, which utilizes hyper-networks in absolute camera pose regressors. The inherent appearance variations in natural scenes, attributable to environmental conditions, perspective, and lighting, induce a significant domain disparity between the training and test datasets. This disparity degrades the precision of contemporary localization networks. To mitigate this, we advocate for incorporating hypernetworks into single-scene and multiscene camera pose regression models. During inference, the hypernetwork dynamically computes adaptive weights for the localization regression heads based on the particular input image, effectively narrowing the domain gap. Using indoor and outdoor datasets, we evaluate the HyperPose methodology across multiple established absolute pose regression architectures. We also introduce and share the Extended Cambridge Landmarks (ECL), a novel localization dataset, based on the Cambridge Landmarks dataset, showing it in multiple seasons with significantly varying appearance conditions. Our empirical experiments demonstrate that HyperPose yields notable performance enhancements for single- and multi-scene architectures. We have made our source code, pre-trained models, and the ECL dataset openly available.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 45 of its 71 references that are in the map. First posted on arXiv 5 Mar 2023.
Builds on
45 of 71 references.
References · 45
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2016HyperNetworkscited by 1,003
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
33 more
- 2021Early Convolutions Help Transformers See Bettercited by 395
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
- 2021Back to the Feature: Learning Robust Camera Localization from Pixels to Posecited by 199
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
- 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
- 2017Learning Less is More - 6D Camera Localization via 3D Surface Regressioncited by 146
- 2016Image-based localization using LSTMs for structured feature correlationcited by 136
- 2015Modelling Uncertainty in Deep Learning for Camera Relocalizationcited by 133
- 2022Map-free Visual Relocalization: Metric Pose Relative to a Single Imagecited by 112
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2019Hierarchical Scene Coordinate Classification and Regression for Visual Localizationcited by 93
- 2019AtLoc: Attention Guided Camera Localizationcited by 92
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2019Expert Sample Consensus Applied to Camera Re-Localizationcited by 70
- 2020HyperSeg: Patch-wise Hypernetwork for Real-time Semantic Segmentationcited by 66
- 2017Image-based Localization using Hourglass Networkscited by 63
- 2018VLocNet++: Deep Multitask Learning for Semantic Visual Localization and Odometrycited by 61
- 2019To Learn or Not to Learn: Visual Localization from Essential Matricescited by 61
- 2019Deep Meta Functionals for Shape Representationcited by 53
- 2021Wide-Baseline Relative Camera Pose Estimation with Directional Learningcited by 49
- 2021Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervisioncited by 37
- 2018RPNet: an End-to-End Network for Relative Camera Pose Estimationcited by 31
- 2022NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera Localizationcited by 26
- 2019Introduction to Camera Pose Estimation with Deep Learningcited by 25
- 2019Local Supports Global: Deep Camera Relocalization with Sequence Enhancementcited by 25
- 2020Learning to Localize in New Environments from Synthetic Training Datacited by 21
- 2020Robust Neural Routing Through Space Partitions for Camera Relocalization in Dynamic Indoor Environmentscited by 19
- 2019Supervised and Unsupervised Learning of Parameterized Color Enhancementcited by 16
- 2021HyperPocket: Generative Point Cloud Completioncited by 12
- 2020Do We Really Need Scene-specific Pose Encoders?cited by 10
- 2022A Critical Analysis of Image-based Camera Pose Estimation Techniquescited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.