# Multimodal Detection of COVID-19 Symptoms using Deep Learning & Probability-based Weighting of Modes

arXiv: https://arxiv.org/abs/2109.01669 · HTML: https://mlsanity.com/paper/2109.01669/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 10 of its 46 references that are in the map.
- First posted on arXiv 3 Sep 2021.

## Builds on (most cited first, 10 of 10)

- [COVIDX-Net: A Framework of Deep Learning Classifiers to Diagnose COVID-19 in X-Ray Images](https://mlsanity.com/paper/2003.11055/) (2020)
- [Exploring Automatic Diagnosis of COVID-19 from Crowdsourced Respiratory Sound Data](https://mlsanity.com/paper/2006.05919/) (2020)
- [The COUGHVID crowdsourcing dataset: A corpus for the study of large-scale cough analysis algorithms](https://mlsanity.com/paper/2009.11644/) (2020)
- [Collaborative Federated Learning For Healthcare: Multi-Modal COVID-19 Diagnosis at the Edge](https://mlsanity.com/paper/2101.07511/) (2021)
- [AI4COVID-19: AI Enabled Preliminary Diagnosis for COVID-19 from Cough Samples via an App](https://mlsanity.com/paper/2004.01275/) (2020)
- [COVID-19 Cough Classification using Machine Learning and Global Smartphone Recordings](https://mlsanity.com/paper/2012.01926/) (2020)
- [Pay Attention to the cough: Early Diagnosis of COVID-19 using Interpretable Symptoms Embeddings with Cough Sound Signal Processing](https://mlsanity.com/paper/2010.02417/) (2020)
- [Multi-modal Point-of-Care Diagnostics for COVID-19 Based On Acoustics and Symptoms](https://mlsanity.com/paper/2106.00639/) (2021)
- [Automatic cough detection based on airflow signals for portable spirometry system](https://mlsanity.com/paper/1903.03588/) (2019)
- [End-to-End AI-Based Point-of-Care Diagnosis System for Classifying Respiratory Illnesses and Early Detection of COVID-19](https://mlsanity.com/paper/2006.15469/) (2020)

## Abstract (arXiv)

The COVID-19 pandemic is one of the most challenging healthcare crises during the 21st century. As the virus continues to spread on a global scale, the majority of efforts have been on the development of vaccines and the mass immunization of the public. While the daily case numbers were following a decreasing trend, the emergent of new virus mutations and variants still pose a significant threat. As economies start recovering and societies start opening up with people going back into office buildings, schools, and malls, we still need to have the ability to detect and minimize the spread of COVID-19. Individuals with COVID-19 may show multiple symptoms such as cough, fever, and shortness of breath. Many of the existing detection techniques focus on symptoms having the same equal importance. However, it has been shown that some symptoms are more prevalent than others. In this paper, we present a multimodal method to predict COVID-19 by incorporating existing deep learning classifiers using convolutional neural networks and our novel probability-based weighting function that considers the prevalence of each symptom. The experiments were performed on an existing dataset with respect to the three considered modes of coughs, fever, and shortness of breath. The results show considerable improvements in the detection of COVID-19 using our weighting function when compared to an equal weighting function.