mlsanityData to 7 Oct 2026

Contrasting Deep Learning Models for Direct Respiratory Insufficiency Detection Versus Blood Oxygen Saturation Estimation

arXiv 2407.20989 ↗First posted 30 Jul 2024cs.SD cs.LG eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

We contrast high effectiveness of state of the art deep learning architectures designed for general audio classification tasks, refined for respiratory insufficiency (RI) detection and blood oxygen saturation (SpO2) estimation and classification through automated audio analysis. Recently, multiple deep learning architectures have been proposed to detect RI in COVID patients through audio analysis, achieving accuracy above 95% and F1-score above 0.93. RI is a condition associated with low SpO2 levels, commonly defined as the threshold SpO2 <92%. While SpO2 serves as a crucial determinant of RI, a medical doctor's diagnosis typically relies on multiple factors. These include respiratory frequency, heart rate, SpO2 levels, among others. Here we study pretrained audio neural networks (CNN6, CNN10 and CNN14) and the Masked Autoencoder (Audio-MAE) for RI detection, where these models achieve near perfect accuracy, surpassing previous results. Yet, for the regression task of estimating SpO2 levels, the models achieve root mean square error values exceeding the accepted clinical range of 3.5% for finger oximeters. Additionally, Pearson correlation coefficients fail to surpass 0.3. As deep learning models perform better in classification than regression, we transform SpO2-regression into a SpO2-threshold binary classification problem, with a threshold of 92%. However, this task still yields an F1-score below 0.65. Thus, audio analysis offers valuable insights into a patient's RI status, but does not provide accurate information about actual SpO2 levels, indicating a separation of domains in which voice and speech biomarkers may and may not be useful in medical diagnostics under current technologies.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 30 Jul 2024.

Builds on

19 of 39 references.

References · 19

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  5. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  6. 2022Masked Autoencoders that Listencited by 271
  7. 2021SSAST: Self-Supervised Audio Spectrogram Transformercited by 166
  8. 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
  9. 2022MAE-AST: Masked Autoencoding Audio Spectrogram Transformercited by 82
  10. 2022Masked Spectrogram Modeling using Masked Autoencoders for Learning General-purpose Audio Representationcited by 52
  11. 2022Masked Spectrogram Prediction For Self-Supervised Audio Pre-Trainingcited by 50
  12. 2021Investigating Local and Global Information for Automated Audio Captioning with Transfer Learningcited by 25
7 more
  1. 2019Cross-task learning for audio tagging, sound event detection and spatial localization: DCASE 2019 baseline systemscited by 6
  2. 2022Exploring Longitudinal Cough, Breath, and Voice Data for COVID-19 Progression Prediction via Sequential Deep Learning: Model Development and Validationcited by 5
  3. 2022Audio MFCC-gram Transformers for respiratory insufficiency detection in COVID-19cited by 4
  4. 2022Pretrained audio neural networks for Speech emotion recognition in Portuguesecited by 3
  5. 2022Interpretability Analysis of Deep Models for COVID-19 Detectioncited by 3
  6. 2023Acoustic models of Brazilian Portuguese Speech based on Neural Transformerscited by 1
  7. 2024Discriminant audio properties in deep learning based respiratory insufficiency detection in Brazilian Portuguesecited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.