mlsanityData to 14 Oct 2026

Multi-Surrogate-Teacher Assistance for Representation Alignment in Fingerprint-based Indoor Localization

arXiv 2412.12189 ↗First posted 13 Dec 2024cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite remarkable progress in knowledge transfer across visual and textual domains, extending these achievements to indoor localization, particularly for learning transferable representations among Received Signal Strength (RSS) fingerprint datasets, remains a challenge. This is due to inherent discrepancies among these RSS datasets, largely including variations in building structure, the input number and disposition of WiFi anchors. Accordingly, specialized networks, which were deprived of the ability to discern transferable representations, readily incorporate environment-sensitive clues into the learning process, hence limiting their potential when applied to specific RSS datasets. In this work, we propose a plug-and-play (PnP) framework of knowledge transfer, facilitating the exploitation of transferable representations for specialized networks directly on target RSS datasets through two main phases. Initially, we design an Expert Training phase, which features multiple surrogate generative teachers, all serving as a global adapter that homogenizes the input disparities among independent source RSS datasets while preserving their unique characteristics. In a subsequent Expert Distilling phase, we continue introducing a triplet of underlying constraints that requires minimizing the differences in essential knowledge between the specialized network and surrogate teachers through refining its representation learning on the target dataset. This process implicitly fosters a representational alignment in such a way that is less sensitive to specific environmental dynamics. Extensive experiments conducted on three benchmark WiFi RSS fingerprint datasets underscore the effectiveness of the framework that significantly exerts the full potential of specialized networks in localization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 43 references that are in the map. First posted on arXiv 13 Dec 2024.

Builds on

16 of 43 references.

References · 16

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2017Improved Training of Wasserstein GANscited by 2,235
  4. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  5. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  6. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,077
  7. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
  8. 2019Big Transfer (BiT): General Visual Representation Learningcited by 769
  9. 2017Spectrally-normalized margin bounds for neural networkscited by 686
  10. 2019Similarity-Preserving Knowledge Distillationcited by 516
  11. 2018Lipschitz regularity of deep neural networks: analysis and efficient estimationcited by 415
  12. 2020A Brief Review of Domain Adaptationcited by 288
4 more
  1. 2018Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neuronscited by 238
  2. 2017Spectral Norm Regularization for Improving the Generalizability of Deep Learningcited by 182
  3. 2020The Lipschitz Constant of Self-Attentioncited by 174
  4. 2021Lipschitz Continuity Guided Knowledge Distillationcited by 19

Built on by

Not cited yet.