# COVIDHealth: A Benchmark Twitter Dataset and Machine Learning based Web Application for Classifying COVID-19 Discussions

arXiv: https://arxiv.org/abs/2402.09897 · HTML: https://mlsanity.com/paper/2402.09897/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 19 of its 105 references that are in the map.
- First posted on arXiv 15 Feb 2024.

## Builds on (most cited first, 19 of 19)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [An Introduction to Convolutional Neural Networks](https://mlsanity.com/paper/1511.08458/) (2015)
- [Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network](https://mlsanity.com/paper/1808.03314/) (2018)
- [TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification](https://mlsanity.com/paper/2010.12421/) (2020)
- [ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learning](https://mlsanity.com/paper/2304.06588/) (2023)
- [Combating Fake News: A Survey on Identification and Mitigation Techniques](https://mlsanity.com/paper/1901.06437/) (2019)
- [AMMU : A Survey of Transformer-based Biomedical Pretrained Language Models](https://mlsanity.com/paper/2105.00827/) (2021)
- [Deep Sentiment Classification and Topic Discovery on Novel Coronavirus or COVID-19 Online Discussions: NLP Using LSTM Recurrent Neural Network Approach](https://mlsanity.com/paper/2004.11695/) (2020)
- [Combined Cleaning and Resampling Algorithm for Multi-Class Imbalanced Data with Label Noise](https://mlsanity.com/paper/2004.03406/) (2020)
- [Are You Robert or RoBERTa? Deceiving Online Authorship Attribution Models Using Neural Text Generators](https://mlsanity.com/paper/2203.09813/) (2022)
- [Tracking Social Media Discourse About the COVID-19 Pandemic: Development of a Public Coronavirus Twitter Data Set](https://mlsanity.com/paper/2003.07372/) (2020)
- [Automatic Detection of COVID-19 Vaccine Misinformation with Graph Link Prediction](https://mlsanity.com/paper/2108.02314/) (2021)
- [EPIC30M: An Epidemics Corpus Of Over 30 Million Relevant Tweets](https://mlsanity.com/paper/2006.08369/) (2020)
- [A Survey of COVID-19 Misinformation: Datasets, Detection Techniques and Open Issues](https://mlsanity.com/paper/2110.00737/) (2021)
- [Prompt, Condition, and Generate: Classification of Unsupported Claims with In-Context Learning](https://mlsanity.com/paper/2309.10359/) (2023)
- [COVIDFakeExplainer: An Explainable Machine Learning based Web Application for Detecting COVID-19 Fake News](https://mlsanity.com/paper/2310.13890/) (2023)
- [Facts and Fabrications about Ebola: A Twitter Based Study](https://mlsanity.com/paper/1508.02079/) (2015)

## Abstract (arXiv)

The COVID-19 pandemic has had adverse effects on both physical and mental health. During this pandemic, numerous studies have focused on gaining insights into health-related perspectives from social media. In this study, our primary objective is to develop a machine learning-based web application for automatically classifying COVID-19-related discussions on social media. To achieve this, we label COVID-19-related Twitter data, provide benchmark classification results, and develop a web application. We collected data using the Twitter API and labeled a total of 6,667 tweets into five different classes: health risks, prevention, symptoms, transmission, and treatment. We extracted features using various feature extraction methods and applied them to seven different traditional machine learning algorithms, including Decision Tree, Random Forest, Stochastic Gradient Descent, Adaboost, K-Nearest Neighbour, Logistic Regression, and Linear SVC. Additionally, we used four deep learning algorithms: LSTM, CNN, RNN, and BERT, for classification. Overall, we achieved a maximum F1 score of 90.43% with the CNN algorithm in deep learning. The Linear SVC algorithm exhibited the highest F1 score at 86.13%, surpassing other traditional machine learning approaches. Our study not only contributes to the field of health-related data analysis but also provides a valuable resource in the form of a web-based tool for efficient data classification, which can aid in addressing public health challenges and increasing awareness during pandemics. We made the dataset and application publicly available, which can be downloaded from this link https://github.com/Bishal16/COVID19-Health-Related-Data-Classification-Website.
