StructVPR++: Distill Structural and Semantic Knowledge with Weighting Samples for Visual Place Recognition
Not on the map. Why?
Abstract (arXiv)
Visual place recognition is a challenging task for autonomous driving and robotics, which is usually considered as an image retrieval problem. A commonly used two-stage strategy involves global retrieval followed by re-ranking using patch-level descriptors. Most deep learning-based methods in an end-to-end manner cannot extract global features with sufficient semantic information from RGB images. In contrast, re-ranking can utilize more explicit structural and semantic information in one-to-one matching process, but it is time-consuming. To bridge the gap between global retrieval and re-ranking and achieve a good trade-off between accuracy and efficiency, we propose StructVPR++, a framework that embeds structural and semantic knowledge into RGB global representations via segmentation-guided distillation. Our key innovation lies in decoupling label-specific features from global descriptors, enabling explicit semantic alignment between image pairs without requiring segmentation during deployment. Furthermore, we introduce a sample-wise weighted distillation strategy that prioritizes reliable training pairs while suppressing noisy ones. Experiments on four benchmarks demonstrate that StructVPR++ surpasses state-of-the-art global methods by 5-23% in Recall@1 and even outperforms many two-stage approaches, achieving real-time efficiency with a single RGB input.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 44 of its 77 references that are in the map. First posted on arXiv 9 Mar 2025.
Builds on
44 of 77 references.
References · 44
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
- 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
32 more
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 185
- 2015Cross Modal Distillation for Supervision Transfercited by 175
- 2016End-to-end Learning of Deep Visual Representations for Image Retrievalcited by 122
- 2020Self-supervising Fine-grained Region Similarities for Large-scale Image Localizationcited by 110
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2023R2Former: Unified Retrieval and Reranking Transformer for Place Recognitioncited by 102
- 2017Deep Learning Features at Scale for Visual Place Recognitioncited by 96
- 2023OrienterNet: Visual Localization in 2D Public Maps with Neural Matchingcited by 84
- 2018Modality Distillation with Multiple Stream Networks for Action Recognitioncited by 83
- 2021SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognitioncited by 57
- 2018Low-resolution Face Recognition in the Wild via Selective Knowledge Distillationcited by 55
- 2018A Holistic Visual Place Recognition Approach using Lightweight CNNs for Significant ViewPoint and Appearance Changescited by 53
- 2017X-View: Graph-Based Semantic Multi-View Localizationcited by 43
- 2021Selective Knowledge Distillation for Neural Machine Translationcited by 43
- 2018Detect-to-Retrieve: Efficient Regional Aggregation for Image Searchcited by 39
- 2019Local Features and Visual Words Emerge in Activationscited by 37
- 2018Single-View Place Recognition under Seasonal Changescited by 35
- 2020Knowledge as Priors: Cross-Modal Knowledge Generalization for Datasets without Superior Knowledgecited by 35
- 2017Large-Scale Domain Adaptation via Teacher-Student Learningcited by 31
- 2020DASGIL: Domain Adaptation for Semantic and Geometric-aware Image-based Localizationcited by 28
- 2023SFD2: Semantic-guided Feature Detection and Descriptioncited by 28
- 2020MobileSal: Extremely Efficient RGB-D Salient Object Detectioncited by 25
- 2020LabelEnc: A New Intermediate Supervision Method for Object Detectioncited by 18
- 2021STA-VPR: Spatio-temporal Alignment for Visual Place Recognitioncited by 15
- 2021Reinforced Iterative Knowledge Distillation for Cross-Lingual Named Entity Recognitioncited by 15
- 2016Bags of Local Convolutional Features for Scalable Instance Searchcited by 13
- 2022StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognitioncited by 13
- 2022Learning Semantics for Visual Place Recognition through Multi-Scale Attentioncited by 11
- 2021Adam revisited: a weighted past gradients perspectivecited by 9
- 2019Image-Based Place Recognition on Bucolic Environment Across Seasons From Semantic Edge Descriptioncited by 8
- 2022Tightly Coupled Learning Strategy for Weakly Supervised Hierarchical Place Recognitioncited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026QdaVPR: A novel query-based domain-agnostic model for visual place recognitioncited by 1
- 2026From Open Waters to Enclosed Cabins: ProteusVPR for Cross-Scene Visual Place Recognition in Maritime Perception and Cabin Inspectioncited by 0
- 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognitioncited by 0
- 2026AdaptVPR: Route-Aware Hard Positive Generation for Robust Visual Place Recognition3 Sep 2026
- 2026From Open Waters to Enclosed Cabins: ProteusVPR for Cross-Scene Visual Place Recognition in Maritime Perception and Cabin Inspection23 Jun 2026
- 2026QdaVPR: A novel query-based domain-agnostic model for visual place recognition8 Mar 2026