Cross-Modal Knowledge Distillation for Acoustic Pedestrian Detection
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
Audio-only pedestrian detection is attractive for urban sensing but limited by weak acoustic cues. An appealing strategy is cross-modal knowledge distillation, in which a video teacher supervises the audio student during training so that the deployed model runs on audio alone. Under this task's severe class imbalance and wide video-audio modality gap, however, what such distillation contributes is unclear. We introduce Trust-Filtered Distillation (TFD), which selectively suppresses teacher supervision on pedestrian samples, and interpret its logit formulation as conditional label smoothing under a shared temperature. Across ten distillation configurations under five-fold cross-session validation on ASPED, most methods yield modest gains in macro accuracy accompanied by small changes in PR-AUC. The main effect is higher no-pedestrian accuracy at the cost of lower pedestrian recall. Adding TFD to logit distillation strengthens this trade-off without improving mean PR-AUC. These findings clarify the benefits and limitations of selective cross-modal supervision by distinguishing operating-point shifts from discrimination gains in imbalanced acoustic detection.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 29 of its 40 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
29 of 40 references.
References · 29
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2019When Does Label Smoothing Help?cited by 988
- 2019Contrastive Representation Distillationcited by 748
- 2016CNN Architectures for Large-Scale Audio Classificationcited by 704
- 2020Long-tail learning via logit adjustmentcited by 618
17 more
- 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 247
- 2018Characterizing and Avoiding Negative Transfercited by 229
- 2021Distilling Audio-Visual Knowledge by Compositional Contrastive Learningcited by 53
- 2021There is More than Meets the Eye: Self-Supervised Multi-Object Detection and Tracking with Sound by Distilling Multimodal Knowledgecited by 44
- 2022The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillationcited by 44
- 2021Confidence-Aware Multi-Teacher Knowledge Distillationcited by 39
- 2022XKD: Cross-modal Knowledge Distillation with Domain Alignment for Video Representation Learningcited by 31
- 2021Balanced Knowledge Distillation for Long-tailed Learningcited by 23
- 2024DeiT-LT Distillation Strikes Back for Vision Transformer Training on Long-Tailed Datasetscited by 14
- 2024Federated Learning with Label-Masking Distillationcited by 7
- 2023Audio Embeddings as Teachers for Music Classificationcited by 5
- 2022Hard Gate Knowledge Distillation -- Leverage Calibration for Robust and Reliable Language Modelcited by 4
- 2024AV-PedAware: Self-Supervised Audio-Visual Fusion for Dynamic Pedestrian Awarenesscited by 4
- 2025The Role of Teacher Calibration in Knowledge Distillationcited by 4
- 2025Self-Filtered Distillation with LLMs-generated Trust Indicators for Reliable Patent Classificationcited by 4
- 2023ASPED: An Audio Dataset for Detecting Pedestrianscited by 3
- 2025Audio-Based Pedestrian Detection in the Presence of Vehicular Noisecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024AMFD: Distillation via Adaptive Multimodal Fusion for Multispectral Pedestrian Detection
- 2026Purify-then-Align: Towards Robust Human Sensing under Modality Missing with Knowledge Distillation from Noisy Multimodal Teacher
- 2023Robust Cross-Modal Knowledge Distillation for Unconstrained Videos
- 2024MSCoTDet: Language-driven Multi-modal Fusion for Improved Multispectral Pedestrian Detection
- 2024Robust Pedestrian Detection via Constructing Versatile Pedestrian Knowledge Bank
- 2025SightSound-R1: Cross-Modal Reasoning Distillation from Vision to Audio Language Models
- 2023Object-centric Cross-modal Feature Distillation for Event-based Object Detection
- 2021Revisiting Knowledge Distillation for Object Detection