TSCM: A Teacher-Student Model for Vision Place Recognition Using Cross-Metric Knowledge Distillation
Not on the map. Why?
Abstract (arXiv)
Visual place recognition (VPR) plays a pivotal role in autonomous exploration and navigation of mobile robots within complex outdoor environments. While cost-effective and easily deployed, camera sensors are sensitive to lighting and weather changes, and even slight image alterations can greatly affect VPR efficiency and precision. Existing methods overcome this by exploiting powerful yet large networks, leading to significant consumption of computational resources. In this paper, we propose a high-performance teacher and lightweight student distillation framework called TSCM. It exploits our devised cross-metric knowledge distillation to narrow the performance gap between the teacher and student models, maintaining superior performance while enabling minimal computational load during deployment. We conduct comprehensive evaluations on large-scale datasets, namely Pittsburgh30k and Pittsburgh250k. Experimental results demonstrate the superiority of our method over baseline models in terms of recognition accuracy and model parameter efficiency. Moreover, our ablation studies show that the proposed knowledge distillation technique surpasses other counterparts. The code of our method has been released at https://github.com/nubot-nudt/TSCM.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 2 Apr 2024.
Builds on
28 of 38 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2019Relational Knowledge Distillationcited by 873
- 2014Deep metric learning using Triplet networkcited by 421
- 2022Decoupled Knowledge Distillationcited by 380
- 2019On the Efficacy of Knowledge Distillationcited by 377
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2019Probabilistic Face Embeddingscited by 171
- 2021OverlapNet: Loop Closing for LiDAR-based SLAMcited by 72
16 more
- 2022OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognitioncited by 69
- 2018A Holistic Visual Place Recognition Approach using Lightweight CNNs for Significant ViewPoint and Appearance Changescited by 53
- 2023A Survey on Global LiDAR Localization: Challenges, Advances and Open Problemscited by 40
- 2019LiDAR Iris for Loop-Closure Detectioncited by 39
- 2020Bayesian Triplet Loss: Uncertainty Quantification in Image Retrievalcited by 31
- 2021Efficient 3D Point Cloud Feature Learning for Large-Scale Place Recognitioncited by 21
- 2022SeqOT: A Spatial-Temporal Transformer Network for Place Recognition Using Sequential LiDAR Datacited by 20
- 2023CVTNet: A Cross-View Transformer Network for Place Recognition Using LiDAR Datacited by 19
- 2022MultiRes-NetVLAD: Augmenting Place Recognition Training with Low-Resolution Imagerycited by 14
- 2022STUN: Self-Teaching Uncertainty Estimation for Place Recognitioncited by 13
- 2022StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognitioncited by 13
- 2022General Place Recognition Survey: Towards the Real-world Autonomy Agecited by 11
- 2022HiTPR: Hierarchical Transformer for Place Recognition in Point Cloudcited by 10
- 2020Triplet Loss for Knowledge Distillationcited by 9
- 2023CCL: Continual Contrastive Learning for LiDAR Place Recognitioncited by 8
- 2019Exploring Uncertainty in Conditional Multi-Modal Retrieval Systemscited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.