Disentangled Learning of Stance and Aspect Topics for Vaccine Attitude Detection in Social Media
Not on the map. Why?
Abstract (arXiv)
Building models to detect vaccine attitudes on social media is challenging because of the composite, often intricate aspects involved, and the limited availability of annotated data. Existing approaches have relied heavily on supervised training that requires abundant annotations and pre-defined aspect categories. Instead, with the aim of leveraging the large amount of unannotated data now available on vaccination, we propose a novel semi-supervised approach for vaccine attitude detection, called VADet. A variational autoencoding architecture based on language models is employed to learn from unlabelled data the topical information of the domain. Then, the model is fine-tuned with a few manually annotated examples of user attitudes. We validate the effectiveness of VADet on our annotated data and also on an existing vaccination corpus annotated with opinions on vaccines. Our results show that VADet is able to learn disentangled stance and aspect topics, and outperforms existing aspect-based sentiment analysis models on both stance detection and tweet clustering.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 36 of its 61 references that are in the map. First posted on arXiv 6 May 2022.
Builds on
36 of 61 references.
References · 36
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
- 2014Semi-Supervised Learning with Deep Generative Modelscited by 496
- 2018Understanding disentangling in β-VAEcited by 335
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 282
24 more
- 2017Toward Controlled Generation of Textcited by 272
- 2020Weakly-Supervised Disentanglement Without Compromisescited by 239
- 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
- 2018Disentangled Representation Learning for Non-Parallel Text Style Transfercited by 127
- 2019Knowing What, How and Why: A Near Complete Solution for Aspect-based Sentiment Analysiscited by 123
- 2020Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Spacecited by 114
- 2017Multi-Level Variational Autoencoder: Learning Disentangled Representations from Grouped Observationscited by 100
- 2020On Disentangled Representations Learned From Correlated Datacited by 94
- 2020Position-Aware Tagging for Aspect Sentiment Triplet Extractioncited by 91
- 2021Supporting Clustering with Contrastive Learningcited by 90
- 2019Exploiting BERT for End-to-End Aspect-based Sentiment Analysiscited by 57
- 2021Topic-Driven and Knowledge-Aware Transformer for Dialogue Emotion Detectioncited by 56
- 2019An Interactive Multi-Task Learning Network for End-to-End Aspect-Based Sentiment Analysiscited by 52
- 2018Transformation Networks for Target-Oriented Sentiment Classificationcited by 47
- 2017Neural Models for Documents with Metadatacited by 46
- 2018Aspect Term Extraction with History Attention and Selective Transformationcited by 37
- 2020A large-scale COVID-19 Twitter chatter dataset for open scientific research -- an international collaborationcited by 33
- 2021Structured Sentiment Analysis as Dependency Graph Parsingcited by 28
- 2021Boosting Low-Resource Biomedical QA via Entity-Aware Masking Strategiescited by 21
- 2020A Disentangled Adversarial Neural Topic Model for Separating Opinions from Plots in User Reviewscited by 12
- 2019TDAM: a Topic-Dependent Attention Model for Sentiment Analysiscited by 7
- 2019Monitoring stance towards vaccination in Twitter messagescited by 4
- 2018Nested LSTMscited by 3
- 2021Evaluation of Thematic Coherence in Microblogscited by 3
Built on by
Citing papers per year: 2023: 3; 2024: 1.
4 papers.
- 2023NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and Sentence-matching Summarizationcited by 13
- 2023Event Temporal Relation Extraction with Bayesian Translational Modelcited by 10
- 2024Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptationcited by 1
- 2023Cone: Unsupervised Contrastive Opinion Extractioncited by 0
- 2024Zero-shot Cross-lingual Stance Detection via Adversarial Language Adaptation22 Apr 2024
- 2023Cone: Unsupervised Contrastive Opinion Extraction8 May 2023
- 2023NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and Sentence-matching Summarization11 Feb 2023
- 2023Event Temporal Relation Extraction with Bayesian Translational Model10 Feb 2023