Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data
Not on the map. Why?
Abstract (arXiv)
Audio signals generated by the human body (e.g., sighs, breathing, heart, digestion, vibration sounds) have routinely been used by clinicians as indicators to diagnose disease or assess disease progression. Until recently, such signals were usually collected through manual auscultation at scheduled visits. Research has now started to use digital technology to gather bodily sounds (e.g., from digital stethoscopes) for cardiovascular or respiratory examination, which could then be used for automatic analysis. Some initial work shows promise in detecting diagnostic signals of COVID-19 from voice and coughs. In this paper we describe our data analysis over a large-scale crowdsourced dataset of respiratory sounds collected to aid diagnosis of COVID-19. We use coughs and breathing to understand how discernible COVID-19 sounds are from those in asthma or healthy controls. Our results show that even a simple binary machine learning classifier is able to classify correctly healthy and COVID-19 sounds. We also show how we distinguish a user who tested positive for COVID-19 and has a cough from a healthy user with a cough, and users who tested positive for COVID-19 and have a cough from users with asthma and a cough. Our models achieve an AUC of above 80% across all tasks. These results are preliminary and only scratch the surface of the potential of this type of data and audio-based machine learning. This work opens the door to further investigation of how automatically analysed respiratory patterns could be used as pre-screening signals to aid COVID-19 diagnosis.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 23; 2022: 19; 2023: 6; 2024: 6; 2025: 5; 2026: 1.
60 papers.
Sort:
By area:
- 2022Vocalsound: A Dataset for Improving Human Vocal Sounds Recognitioncited by 62
- 2021The INTERSPEECH 2021 Computational Paralinguistics Challenge: COVID-19 Cough, COVID-19 Speech, Escalation & Primatescited by 32
- 2021Sounds of COVID-19: exploring realistic performance of audio-based digital testingcited by 20
- 2021Automatic Cough Classification for Tuberculosis Screening in a Real-World Environmentcited by 17
- 2021Exploring Self-Supervised Representation Ensembles for COVID-19 Cough Classificationcited by 16
- 2022Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkerscited by 12
- 2021Biometrics in the Era of COVID-19: Challenges and Opportunitiescited by 11
- 2021COVID-19 Detection in Cough, Breath and Speech using Deep Transfer Learning and Bottleneck Featurescited by 9
- 2021FRuDA: Framework for Distributed Adversarial Domain Adaptationcited by 8
- 2021Virufy: A Multi-Branch Deep Learning Network for Automated Detection of COVID-19cited by 7
- 2021COVID-19 Modeling: A Reviewcited by 7
- 2021From Personalized Medicine to Population Health: A Survey of mHealth Sensing Techniquescited by 7
38 more
- 2021Project Achoo: A Practical Model and Application for COVID-19 Detection from Recordings of Breath, Voice, and Coughcited by 7
- 2023Hybrid Approaches for Moral Value Alignment in AI Agents: a Manifestocited by 7
- 2021Uncertainty-Aware COVID-19 Detection from Imbalanced Sound Datacited by 6
- 2021Benchmarking Uncertainty Quantification on Biosignal Classification Tasks under Dataset Shiftcited by 6
- 2023(Un)fair devices: Moving beyond AI accuracy in personal sensingcited by 6
- 2021Evaluating the COVID-19 Identification ResNet (CIdeR) on the INTERSPEECH COVID-19 from Audio Challengescited by 5
- 2022Exploring Longitudinal Cough, Breath, and Voice Data for COVID-19 Progression Prediction via Sequential Deep Learning: Model Development and Validationcited by 5
- 2023Towards using Cough for Respiratory Disease Diagnosis by leveraging Artificial Intelligence: A Surveycited by 5
- 2022COVID-19 Detection from Respiratory Sounds with Hierarchical Spectrogram Transformerscited by 4
- 2022A large-scale and PCR-referenced vocal audio dataset for COVID-19cited by 4
- 2025Robust COVID-19 Detection from Cough Sounds using Deep Neural Decision Tree and Forest: A Comprehensive Cross-Datasets Evaluationcited by 4
- 2021Audio feature ranking for sound-based COVID-19 patient detectioncited by 3
- 2022Using Deep Learning with Large Aggregated Datasets for COVID-19 Classification from Coughcited by 3
- 2022Interpretability Analysis of Deep Models for COVID-19 Detectioncited by 3
- 2021End-2-End COVID-19 Detection from Breath & Cough Audiocited by 2
- 2021Deep Neural Network Based Respiratory Pathology Classification Using Cough Soundscited by 2
- 2022TinyM2Net: A Flexible System Algorithm Co-designed Multimodal Learning Framework for Tiny Devicescited by 2
- 2022A Summary of the ComParE COVID-19 Challengescited by 2
- 2022L3-Net Deep Audio Embeddings to Improve COVID-19 Detection from Smartphone Datacited by 2
- 2024Voice EHR: Introducing Multimodal Audio Data for Healthcited by 2
- 2025Cough Classification using Few-Shot Learningcited by 2
- 2021Automatic COVID-19 disease diagnosis using 1D convolutional neural network and augmentation with human respiratory sound based on parameters: cough, breath, and voicecited by 1
- 2022Statistical Design and Analysis for Robust Machine Learning: A Case Study from COVID-19cited by 1
- 2022Visual Transformers for Primates Classification and Covid Detectioncited by 1
- 2024Developing a Multi-variate Prediction Model For COVID-19 From Crowd-sourced Respiratory Voice Datacited by 1
- 2025Detection of Disease on Nasal Breath Sound by New Lightweight Architecture: Using COVID-19 as An Examplecited by 1
- 2025XAI-Driven Spectral Analysis of Cough Sounds for Respiratory Disease Characterizationcited by 1
- 2021Computer Vision-based Social Distancing Surveillance Solution with Optional Automated Camera Calibration for Large Scale Deploymentcited by 0
- 2021Impact of data-splits on generalization: Identifying COVID-19 from cough and contextcited by 0
- 2021Multimodal Detection of COVID-19 Symptoms using Deep Learning & Probability-based Weighting of Modescited by 0
- 2021Fruit-CoV: An Efficient Vision-based Framework for Speedy Detection and Diagnosis of SARS-CoV-2 Infections Through Recorded Cough Soundscited by 0
- 2021An Ensemble-based Multi-Criteria Decision Making Method for COVID-19 Cough Classificationcited by 0
- 2022Using a Novel COVID-19 Calculator to Measure Positive U.S. Socio-Economic Impact of a COVID-19 Pre-Screening Solution (AI/ML)cited by 0
- 2022A Temporal-oriented Broadcast ResNet for COVID-19 Detectioncited by 0
- 2022On the pragmatism of using binary classifiers over data intensive neural network classifiers for detection of COVID-19 from voicecited by 0
- 2022Fused Audio Instance and Representation for Respiratory Disease Detectioncited by 0
- 2022The AI Mechanic: Acoustic Vehicle Characterization Neural Networkscited by 0
- 2022Coswara: A website application enabling COVID-19 screening by analysing respiratory sound samples and health symptomscited by 0
50 most cited of 60 All 60 (JSON)
- 2026CoughSense: Five-Class Respiratory Disease Classification via Whisper Encoder Fine-Tuning and Dual-Encoder Cross-Attention Fusion with Balanced Contrastive Learning2 Jun 2026
- 2025Cough Classification using Few-Shot Learning11 Sep 2025
- 2025XAI-Driven Spectral Analysis of Cough Sounds for Respiratory Disease Characterization20 Aug 2025
- 2025CoughViT: A Self-Supervised Vision Transformer for Cough Audio Representation Learning4 Aug 2025
- 2025Detection of Disease on Nasal Breath Sound by New Lightweight Architecture: Using COVID-19 as An Example1 Apr 2025
- 2025Robust COVID-19 Detection from Cough Sounds using Deep Neural Decision Tree and Forest: A Comprehensive Cross-Datasets Evaluation2 Jan 2025
- 2024From Lab to Pocket: A Novel Continual Learning-based Mobile Application for Screening COVID-1916 Oct 2024
- 2024Sustaining model performance for covid-19 detection from dynamic audio data: Development and evaluation of a comprehensive drift-adaptive framework28 Sep 2024
- 2024Optimising MFCC parameters for the automatic detection of respiratory diseases14 Aug 2024
- 2024Voice EHR: Introducing Multimodal Audio Data for Health2 Apr 2024
- 2024Developing a Multi-variate Prediction Model For COVID-19 From Crowd-sourced Respiratory Voice Data12 Feb 2024
- 2024An AI-enabled Bias-Free Respiratory Disease Diagnosis Model using Cough Audio: A Case Study for COVID-194 Jan 2024
38 more
- 2023Hybrid Approaches for Moral Value Alignment in AI Agents: a Manifesto4 Dec 2023
- 2023Towards using Cough for Respiratory Disease Diagnosis by leveraging Artificial Intelligence: A Survey24 Sep 2023
- 2023FairComp: Workshop on Fairness and Robustness in Machine Learning for Ubiquitous Computing22 Sep 2023
- 2023EDAC: Efficient Deployment of Audio Classification Models For COVID-19 Detection11 Sep 2023
- 2023COVID-19 Detection System: A Comparative Analysis of System Performance Based on Acoustic Features of Cough Audio Signals8 Sep 2023
- 2023(Un)fair devices: Moving beyond AI accuracy in personal sensing27 Mar 2023
- 2022Visual Transformers for Primates Classification and Covid Detection20 Dec 2022
- 2022Statistical Design and Analysis for Robust Machine Learning: A Case Study from COVID-1915 Dec 2022
- 2022Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers15 Dec 2022
- 2022A large-scale and PCR-referenced vocal audio dataset for COVID-1915 Dec 2022
- 2022Interpretability Analysis of Deep Models for COVID-19 Detection25 Nov 2022
- 2022Developing a multi-variate prediction model for the detection of COVID-19 from Crowd-sourced Respiratory Voice Data8 Sep 2022
- 2022COVID-19 Detection from Respiratory Sounds with Hierarchical Spectrogram Transformers19 Jul 2022
- 2022Coswara: A website application enabling COVID-19 screening by analysing respiratory sound samples and health symptoms9 Jun 2022
- 2022The AI Mechanic: Acoustic Vehicle Characterization Neural Networks19 May 2022
- 2022L3-Net Deep Audio Embeddings to Improve COVID-19 Detection from Smartphone Data16 May 2022
- 2022Vocalsound: A Dataset for Improving Human Vocal Sounds Recognition6 May 2022
- 2022Fused Audio Instance and Representation for Respiratory Disease Detection22 Apr 2022
- 2022On the pragmatism of using binary classifiers over data intensive neural network classifiers for detection of COVID-19 from voice11 Apr 2022
- 2022A Temporal-oriented Broadcast ResNet for COVID-19 Detection31 Mar 2022
- 2022A Summary of the ComParE COVID-19 Challenges17 Feb 2022
- 2022TinyM2Net: A Flexible System Algorithm Co-designed Multimodal Learning Framework for Tiny Devices9 Feb 2022
- 2022Using a Novel COVID-19 Calculator to Measure Positive U.S. Socio-Economic Impact of a COVID-19 Pre-Screening Solution (AI/ML)21 Jan 2022
- 2022Using Deep Learning with Large Aggregated Datasets for COVID-19 Classification from Cough5 Jan 2022
- 2022Exploring Longitudinal Cough, Breath, and Voice Data for COVID-19 Progression Prediction via Sequential Deep Learning: Model Development and Validation4 Jan 2022
- 2021FRuDA: Framework for Distributed Adversarial Domain Adaptation26 Dec 2021
- 2021Benchmarking Uncertainty Quantification on Biosignal Classification Tasks under Dataset Shift16 Dec 2021
- 2021Automatic COVID-19 disease diagnosis using 1D convolutional neural network and augmentation with human respiratory sound based on parameters: cough, breath, and voice14 Dec 2021
- 2021An Ensemble-based Multi-Criteria Decision Making Method for COVID-19 Cough Classification1 Oct 2021
- 2021Fruit-CoV: An Efficient Vision-based Framework for Speedy Detection and Diagnosis of SARS-CoV-2 Infections Through Recorded Cough Sounds6 Sep 2021
- 2021Multimodal Detection of COVID-19 Symptoms using Deep Learning & Probability-based Weighting of Modes3 Sep 2021
- 2021Evaluating the COVID-19 Identification ResNet (CIdeR) on the INTERSPEECH COVID-19 from Audio Challenges30 Jul 2021
- 2021Project Achoo: A Practical Model and Application for COVID-19 Detection from Recordings of Breath, Voice, and Cough12 Jul 2021
- 2021From Personalized Medicine to Population Health: A Survey of mHealth Sensing Techniques2 Jul 2021
- 2021Sounds of COVID-19: exploring realistic performance of audio-based digital testing29 Jun 2021
- 2021Deep Neural Network Based Respiratory Pathology Classification Using Cough Sounds23 Jun 2021
- 2021Impact of data-splits on generalization: Identifying COVID-19 from cough and context5 Jun 2021
- 2021Exploring Self-Supervised Representation Ensembles for COVID-19 Cough Classification17 May 2021
50 newest of 60 All 60 (JSON)
- 2022Vocalsound: A Dataset for Improving Human Vocal Sounds Recognitioncited by 62
- 2021The INTERSPEECH 2021 Computational Paralinguistics Challenge: COVID-19 Cough, COVID-19 Speech, Escalation & Primatescited by 32
- 2021Sounds of COVID-19: exploring realistic performance of audio-based digital testingcited by 20
- 2021Automatic Cough Classification for Tuberculosis Screening in a Real-World Environmentcited by 17
- 2021Exploring Self-Supervised Representation Ensembles for COVID-19 Cough Classificationcited by 16
- 2022Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkerscited by 12
- 2021Biometrics in the Era of COVID-19: Challenges and Opportunitiescited by 11
- 2021COVID-19 Detection in Cough, Breath and Speech using Deep Transfer Learning and Bottleneck Featurescited by 9
- 2021FRuDA: Framework for Distributed Adversarial Domain Adaptationcited by 8
- 2021Virufy: A Multi-Branch Deep Learning Network for Automated Detection of COVID-19cited by 7
- 2021COVID-19 Modeling: A Reviewcited by 7
- 2021From Personalized Medicine to Population Health: A Survey of mHealth Sensing Techniquescited by 7
12 most cited of 59 All 59 (JSON)
- 2026CoughSense: Five-Class Respiratory Disease Classification via Whisper Encoder Fine-Tuning and Dual-Encoder Cross-Attention Fusion with Balanced Contrastive Learning2 Jun 2026
- 2025Cough Classification using Few-Shot Learning11 Sep 2025
- 2025XAI-Driven Spectral Analysis of Cough Sounds for Respiratory Disease Characterization20 Aug 2025
- 2025CoughViT: A Self-Supervised Vision Transformer for Cough Audio Representation Learning4 Aug 2025
- 2025Detection of Disease on Nasal Breath Sound by New Lightweight Architecture: Using COVID-19 as An Example1 Apr 2025
- 2025Robust COVID-19 Detection from Cough Sounds using Deep Neural Decision Tree and Forest: A Comprehensive Cross-Datasets Evaluation2 Jan 2025
- 2024From Lab to Pocket: A Novel Continual Learning-based Mobile Application for Screening COVID-1916 Oct 2024
- 2024Sustaining model performance for covid-19 detection from dynamic audio data: Development and evaluation of a comprehensive drift-adaptive framework28 Sep 2024
- 2024Optimising MFCC parameters for the automatic detection of respiratory diseases14 Aug 2024
- 2024Voice EHR: Introducing Multimodal Audio Data for Health2 Apr 2024
- 2024Developing a Multi-variate Prediction Model For COVID-19 From Crowd-sourced Respiratory Voice Data12 Feb 2024
- 2024An AI-enabled Bias-Free Respiratory Disease Diagnosis Model using Cough Audio: A Case Study for COVID-194 Jan 2024
12 newest of 59 All 59 (JSON)