VG-SSL: Benchmarking Self-supervised Representation Learning Approaches for Visual Geo-localization
Not on the map. Why?
Abstract (arXiv)
Visual Geo-localization (VG) is a critical research area for identifying geo-locations from visual inputs, particularly in autonomous navigation for robotics and vehicles. Current VG methods often learn feature extractors from geo-labeled images to create dense, geographically relevant representations. Recent advances in Self-Supervised Learning (SSL) have demonstrated its capability to achieve performance on par with supervised techniques with unlabeled images. This study presents a novel VG-SSL framework, designed for versatile integration and benchmarking of diverse SSL methods for representation learning in VG, featuring a unique geo-related pair strategy, GeoPair. Through extensive performance analysis, we adapt SSL techniques to improve VG on datasets from hand-held and car-mounted cameras used in robotics and autonomous vehicles. Our results show that contrastive learning and information maximization methods yield superior geo-specific representation quality, matching or surpassing the performance of state-of-the-art VG techniques. To our knowledge, This is the first benchmarking study of SSL in VG, highlighting its potential in enhancing geo-specific visual representations for robotics and autonomous vehicles. The code is publicly available at https://github.com/arplaboratory/VG-SSL.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 35 of its 56 references that are in the map. First posted on arXiv 31 Jul 2023.
Builds on
35 of 56 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,287
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
23 more
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2020Geography-Aware Self-Supervised Learningcited by 190
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 163
- 2015Particular object retrieval with integral max-pooling of CNN activationscited by 161
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 161
- 2022Self-supervised Learning in Remote Sensing: A Reviewcited by 137
- 2020Self-supervising Fine-grained Region Similarities for Large-scale Image Localizationcited by 110
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
- 2017Deep Learning Features at Scale for Visual Place Recognitioncited by 96
- 2022GSV-Cities: Toward Appropriate Supervised Visual Place Recognitioncited by 93
- 2022Deep Visual Geo-localization Benchmarkcited by 84
- 2015Aggregating Deep Convolutional Features for Image Retrievalcited by 63
- 2014Visual Instance Retrieval with Deep Convolutional Networkscited by 48
- 2023Data-efficient Large Scale Place Recognition with Graded Similarity Supervisioncited by 43
- 2022MultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagerycited by 14
- 2023Long-range UAV Thermal Geo-localization with Satellite Imagerycited by 12
- 2023Global Proxy-based Hard Mining for Visual Place Recognitioncited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 1.
4 papers.
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
- 2024Learning Cross-view Visual Geo-localization without Ground Truthcited by 18
- 2025Query-Based Adaptive Aggregation for Multi-Dataset Joint Training Toward Universal Visual Place Recognitioncited by 1
- 2026Geometric Analysis of Self-Supervised Vision Representations for Semantic Image Retrievalcited by 0
- 2026Geometric Analysis of Self-Supervised Vision Representations for Semantic Image Retrieval27 Apr 2026
- 2025Query-Based Adaptive Aggregation for Multi-Dataset Joint Training Toward Universal Visual Place Recognition4 Jul 2025
- 2024Learning Cross-view Visual Geo-localization without Ground Truth19 Mar 2024
- 2023AnyLoc: Towards Universal Visual Place Recognition1 Aug 2023