UQ at #SMM4H 2023: ALEX for Public Health Analysis with Social Media
Not on the map. Why?
Abstract (arXiv)
As social media becomes increasingly popular, more and more activities related to public health emerge. Current techniques for public health analysis involve popular models such as BERT and large language models (LLMs). However, the costs of training in-domain LLMs for public health are especially expensive. Furthermore, such kinds of in-domain datasets from social media are generally imbalanced. To tackle these challenges, the data imbalance issue can be overcome by data augmentation and balanced training. Moreover, the ability of the LLMs can be effectively utilized by prompting the model properly. In this paper, a novel ALEX framework is proposed to improve the performance of public health analysis on social media by adopting an LLMs explanation mechanism. Results show that our ALEX model got the best performance among all submissions in both Task 2 and Task 4 with a high score in Task 1 in Social Media Mining for Health 2023 (SMM4H)[1]. Our code has been released at https:// github.com/YanJiangJerry/ALEX.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 6 of its 8 references that are in the map. First posted on arXiv 8 Sep 2023.
Builds on
6 of 8 references.
References · 6
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2020BERTweet: A pre-trained language model for English Tweetscited by 346
- 2020COVID-Twitter-BERT: A Natural Language Processing Model to Analyse COVID-19 Content on Twittercited by 96
Built on by
Citing papers per year: 2023: 1.
1 paper.