# A Multi-Stage Hybrid CNN-Transformer Network for Automated Pediatric Lung Sound Classification

arXiv: https://arxiv.org/abs/2507.20408 · HTML: https://mlsanity.com/paper/2507.20408/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 14 of its 48 references that are in the map.
- First posted on arXiv 27 Jul 2025.

## Builds on (most cited first, 14 of 14)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Going Deeper with Convolutions](https://mlsanity.com/paper/1409.4842/) (2014)
- [MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications](https://mlsanity.com/paper/1704.04861/) (2017)
- [Pretraining Respiratory Sound Representations using Metadata and Contrastive Learning](https://mlsanity.com/paper/2210.16192/) (2022)
- [Deep auscultation: Predicting respiratory anomalies and diseases via recurrent neural networks](https://mlsanity.com/paper/1907.05708/) (2019)
- [A Lightweight CNN Model for Detecting Respiratory Diseases from Lung Auscultation Sounds using EMD-CWT-based Hybrid Scalogram](https://mlsanity.com/paper/2009.04402/) (2020)
- [Robust Deep Learning Framework For Predicting Respiratory Anomalies and Diseases](https://mlsanity.com/paper/2002.03894/) (2020)
- [Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning](https://mlsanity.com/paper/2004.08287/) (2020)
- [Deep Learning Framework Applied for Predicting Anomaly of Respiratory Sounds](https://mlsanity.com/paper/2012.13668/) (2020)
- [Classify Respiratory Abnormality in Lung Sounds Using STFT and a Fine-Tuned ResNet18 Network](https://mlsanity.com/paper/2208.13943/) (2022)
- [An Inception-Residual-Based Architecture with Multi-Objective Loss for Detecting Respiratory Anomalies](https://mlsanity.com/paper/2303.04104/) (2023)
- [A Deep Learning Architecture with Spatio-Temporal Focusing for Detecting Respiratory Anomalies](https://mlsanity.com/paper/2306.14929/) (2023)

## Abstract (arXiv)

Automated analysis of lung sound auscultation is essential for monitoring respiratory health, especially in regions facing a shortage of skilled healthcare workers. While respiratory sound classification has been widely studied in adults, its ap plication in pediatric populations, particularly in children aged <6 years, remains an underexplored area. The developmental changes in pediatric lungs considerably alter the acoustic proper ties of respiratory sounds, necessitating specialized classification approaches tailored to this age group. To address this, we propose a multistage hybrid CNN-Transformer framework that combines CNN-extracted features with an attention-based architecture to classify pediatric respiratory diseases using scalogram images from both full recordings and individual breath events. Our model achieved an overall score of 0.9039 in binary event classifi cation and 0.8448 in multiclass event classification by employing class-wise focal loss to address data imbalance. At the recording level, the model attained scores of 0.720 for ternary and 0.571 for multiclass classification. These scores outperform the previous best models by 3.81% and 5.94%, respectively. This approach offers a promising solution for scalable pediatric respiratory disease diagnosis, especially in resource-limited settings.
