Improving Deep Learning-based Respiratory Sound Analysis with Frequency Selection and Attention Mechanism
Not on the map. Why?
Abstract (arXiv)
Accurate classification of respiratory sounds requires deep learning models that effectively capture fine-grained acoustic features and long-range temporal dependencies. Convolutional Neural Networks (CNNs) are well-suited for extracting local time-frequency patterns but are limited in modeling global context. In contrast, transformer-based models can capture long-range dependencies, albeit with higher computational demands. To address these limitations, we propose a compact CNN-Temporal Self-Attention (CNN-TSA) network that integrates lightweight self-attention into an efficient CNN backbone. Central to our approach is a Frequency Band Selection (FBS) module that suppresses noisy and non-informative frequency regions, substantially improving accuracy and reducing FLOPs by up to 50%. We also introduce age-specific models to enhance robustness across diverse patient groups. Evaluated on the SPRSound-2022/2023 and ICBHI-2017 lung sound datasets, CNN-TSA with FBS sets new benchmarks on SPRSound and achieves state-of-the-art performance on ICBHI, all with a significantly smaller computational footprint. Furthermore, integrating FBS into an existing transformer baseline yields a new record on ICBHI, confirming FBS as an effective drop-in enhancement. These results demonstrate that our framework enables reliable, real-time respiratory sound analysis suitable for deployment in resource-constrained settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 70 references that are in the map. First posted on arXiv 26 Jul 2025.
Builds on
25 of 70 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2021Transformers in Vision: A Surveycited by 1,013
- 2021AST: Audio Spectrogram Transformercited by 643
- 2013Network In Networkcited by 605
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
- 2019Deep Learning for Audio Signal Processingcited by 92
- 2020The Real-World-Weight Cross-Entropy Loss Function: Modeling the Costs of Mislabelingcited by 64
- 2020RespireNet: A Deep Neural Network for Accurately Detecting Abnormal Lung Sounds in Limited Data Settingcited by 26
- 2023Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classificationcited by 24
13 more
- 2024Masked Modeling Duo: Towards a Universal Audio Pre-training Frameworkcited by 23
- 2021Prototype Learning for Interpretable Respiratory Sound Analysiscited by 21
- 2023Stethoscope-guided Supervised Contrastive Learning for Cross-domain Adaptation on Respiratory Sound Classificationcited by 16
- 2022Pretraining Respiratory Sound Representations using Metadata and Contrastive Learningcited by 15
- 2021Lung Sound Classification Using Co-tuning and Stochastic Normalizationcited by 14
- 2022Example-based Explanations with Adversarial Attacks for Respiratory Sound Analysiscited by 13
- 2024BTS: Bridging Text and Sound Modalities for Metadata-Aided Respiratory Sound Classificationcited by 12
- 2017A Tutorial on Deep Learning for Music Information Retrievalcited by 9
- 2022Classify Respiratory Abnormality in Lung Sounds Using STFT and a Fine-Tuned ResNet18 Networkcited by 3
- 2023Multi-View Spectrogram Transformer for Respiratory Sound Classificationcited by 3
- 2023A Deep Learning Architecture with Spatio-Temporal Focusing for Detecting Respiratory Anomaliescited by 2
- 2023Feature Selection: A perspective on inter-attribute cooperationcited by 2
- 2024Classification of Adventitious Sounds Combining Cochleogram and Vision Transformerscited by 2
Built on by
Not cited yet.