RAST: Resolution-Aware Privileged Structure Transfer for Low-Resolution Audio Activity Recognition
Not on the map. Why?
Abstract (arXiv)
Audio is increasingly used for human activity recognition (HAR) because it captures object interactions, environmental events, and contextual cues in everyday environments. High-resolution (HR) audio provides rich acoustic information for model development but incurs substantial energy and storage costs and may expose sensitive speech content. Low-resolution (LR) audio offers a more privacy-preserving and resource-efficient alternative for deployment, but reduced sampling rates can remove acoustic cues essential for activity recognition, leading to significant performance degradation. We formulate this training-deployment mismatch as sensor-resolution privileged learning, in which HR audio is available during training, while inference relies exclusively on LR audio. We propose RAST, a resolution-aware transfer framework that compresses HR teacher representations by preserving token-level information and neighborhood structure before performing localized HR-LR alignment. Experiments on the SAMoSA and AudioIMU datasets show that RAST consistently outperforms LR-only training and direct teacher-transfer baselines, improving LR-only recognition by up to approximately 7.8% while requiring only LR audio at inference.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
20 of 33 references.
References · 20
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2017Neural Discrete Representation Learningcited by 4,712
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2016Deep Variational Information Bottleneckcited by 930
- 2019Relational Knowledge Distillationcited by 889
- 2019Contrastive Representation Distillationcited by 748
- 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 640
- 2020Contrastive Learning with Hard Negative Samplescited by 628
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
- 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 247
8 more
- 2015Unifying distillation and privileged informationcited by 233
- 2015Cross Modal Distillation for Supervision Transfercited by 175
- 2017Deep Learning for Sensor-based Activity Recognition: A Surveycited by 133
- 2018Audio-Based Activities of Daily Living (ADL) Recognition with Large-Scale Acoustic Embeddings from Online Videoscited by 13
- 2014DSP.Ear: Leveraging Co-Processor Support for Continuous Audio Sensing on Smartphonescited by 7
- 2021Zero-Shot Federated Learning with New Classes for Audio Classificationcited by 4
- 2017User Environment Detection with Acoustic Sensors Embedded on Mobile Devices for the Recognition of Activities of Daily Livingcited by 2
- 2025FeatureSense: Protecting Speaker Attributes in Always-On Audio Sensing Systemcited by 1
Built on by
Not cited yet.