SGL: Structure Guidance Learning for Camera Localization
Not on the map. Why?
Abstract (arXiv)
Camera localization is a classical computer vision task that serves various Artificial Intelligence and Robotics applications. With the rapid developments of Deep Neural Networks (DNNs), end-to-end visual localization methods are prosperous in recent years. In this work, we focus on the scene coordinate prediction ones and propose a network architecture named as Structure Guidance Learning (SGL) which utilizes the receptive branch and the structure branch to extract both high-level and low-level features to estimate the 3D coordinates. We design a confidence strategy to refine and filter the predicted 3D observations, which enables us to estimate the camera poses by employing the Perspective-n-Point (PnP) with RANSAC. In the training part, we design the Bundle Adjustment trainer to help the network fit the scenes better. Comparisons with some state-of-the-art (SOTA) methods and sufficient ablation experiments confirm the validity of our proposed architecture.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 12 Apr 2023.
Builds on
31 of 47 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2020DISK: Learning local features with policy gradientcited by 310
- 2020BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentationcited by 294
- 2016DSAC - Differentiable RANSAC for Camera Localizationcited by 264
- 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
- 2017Geometric Loss Functions for Camera Pose Regression with Deep Learningcited by 224
19 more
- 2019R2D2: Repeatable and Reliable Detector and Descriptorcited by 206
- 2019Understanding the Limitations of CNN-based Absolute Camera Pose Regressioncited by 177
- 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
- 2017Geometry-Aware Learning of Maps for Camera Localizationcited by 161
- 2017Learning Less is More - 6D Camera Localization via 3D Surface Regressioncited by 146
- 2016Image-based localization using LSTMs for structured feature correlationcited by 136
- 2015Modelling Uncertainty in Deep Learning for Camera Relocalizationcited by 133
- 2021Learning Multi-Scene Absolute Pose Regression with Transformerscited by 108
- 2017Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activationscited by 104
- 2019AtLoc: Attention Guided Camera Localizationcited by 92
- 2021On the Limits of Pseudo Ground Truth in Visual Camera Re-localisationcited by 63
- 2020Learning and aggregating deep local descriptors for instance-level recognitioncited by 54
- 2021VS-Net: Voting with Segmentation for Visual Localizationcited by 29
- 2021Learning Camera Localization via Dense Scene Matchingcited by 28
- 2016Random Forests versus Neural Networks - What's Best for Camera Localization?cited by 15
- 2021Pose Refinement with Joint Optimization of Visual Points and Linescited by 14
- 2018Full-Frame Scene Coordinate Regression for Image-Based Localizationcited by 13
- 2020Reference Pose Generation for Long-term Visual Localization via Learned Features and View Synthesiscited by 10
- 2021Retrieval and Localization with Observation Constraintscited by 6
Built on by
Not cited yet.