Register assisted aggregation for Visual Place Recognition
Not on the map. Why?
Abstract (arXiv)
Visual Place Recognition (VPR) refers to the process of using computer vision to recognize the position of the current query image. Due to the significant changes in appearance caused by season, lighting, and time spans between query images and database images for retrieval, these differences increase the difficulty of place recognition. Previous methods often discarded useless features (such as sky, road, vehicles) while uncontrolled discarding features that help improve recognition accuracy (such as buildings, trees). To preserve these useful features, we propose a new feature aggregation method to address this issue. Specifically, in order to obtain global and local features that contain discriminative place information, we added some registers on top of the original image tokens to assist in model training. After reallocating attention weights, these registers were discarded. The experimental results show that these registers surprisingly separate unstable features from the original image representation and outperform state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 19 May 2024.
Builds on
24 of 35 references.
References · 24
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2014Going Deeper with Convolutionscited by 4,231
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2023Vision Transformers Need Registerscited by 844
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 497
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 160
12 more
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 159
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
- 2023EigenPlaces: Training Viewpoint Robust Models for Visual Place Recognitioncited by 109
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
- 2020VPR-Bench: An Open-Source Visual Place Recognition Evaluation Framework with Quantifiable Viewpoint and Appearance Changecited by 101
- 2022GSV-Cities: Toward Appropriate Supervised Visual Place Recognitioncited by 92
- 2024CricaVPR: Cross-image Correlation-aware Representation Learning for Visual Place Recognitioncited by 61
- 2019Scalable Place Recognition Under Appearance Change for Autonomous Drivingcited by 42
- 2023Adaptive Computation with Elastic Input Sequencecited by 22
- 2021Probabilistic Visual Place Recognition for Hierarchical Localizationcited by 20
Built on by
Not cited yet.